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This  work  is  concerned  with  rational  covariance  extensions  of 
partial  sequences.  Certain  methods  of  the  classical  interpolation 
theory  are  exploited  and  a  novel  topological  approach  is  developed. 
An  associated  polynomial,  that  we  call  the  "dissipation  polynomial", 
is  found  to  be  a  free  parameter  for  covariance  extensions  with 
dimension  bounded  by  the  number  of  data.  A  similar  result  holds  for 
the  case  of  matrix  sequences  as  well. 

The  dissipation  polynomial  is  found  to  impose  an  "almost 
recurrence"  law  on  the  SCHUR  parameters  of  rational  covariance 
sequences.  This  is  done  via  a  new  approach  to  spectral  factorization. 
These  theoretical  results,  placed  in  the  context  of  the  applied 
area  of  spectral  estimation  theory,  suggest  some  recursive  procedure 
for  pole- zero  modeling. 


CHAPTER  I.   INTRODUCTION 

The  elementary  notion  of  positivity  of  real  numbers  has  found 
various  generalizations  to  that  of  quadratic  forms,  operators  etc. 
These  play  a  key  role  in,  not  only  mathematics,  but  many  areas  of 
applied  science  as  well.   The  reason  is  that  positivity  is,  in  one 
form  or  another,  intimately  related  with  the  manifestations  of 
physical  quantities  and  entities. 

The  motivation  for  this  work  arises  from  the  area  of  stochastic 
processes  and  identification  theory.   The  covariance  function 
c  :=  Ey  y   ,  s  =  0,  +  1,  . . . ,   of  a  discrete-time,  zero-mean, 
stationary  stochastic  process  y  ,  T  G  Z,   is  characterized  by  the 
nonnegative  definiteness  of  the  Toeplitz  quadratic  forms 

u    v 

Z   ,  Z  a  c   b  , 
s=o  t=o  s  s-t  t 

for  u,   v  =  0,    1,    . . . ,      and     a   ,   b     G  C.      This  is   the  notion  of 
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positivity  which  plays  a  central  role  in  our  work. 

A  stochastic  process  is  an  abstraction.   The  real  object  is  a 
realization  of  the  process:  a  time-series.   The  probabilistic 
behavior  is  not  available.  For  identification  and  prediction, 
estimates  of  the  means  and  covariances  of  the  stochastic  process 
have  to  be  computed  from  some  observation  record.   In  this,  a  large 
number  of  issues  are  involved.  Most  of  them  are  of  a  statistical 
nature  (confidence  limits,  etc.).   Theoretically,  most  of  these 
issues  are  still  terra  incognita. 

In  this  work  we  shall  not  be  concerned  about  such  questions  but 
we  shall  assume  as  the  given  data  a  partial  sequence  of  covariances 
C  :=  {c  :  t  =  0,  1,  ...,  s}.   This  is  the  standing  assumption  for 

S  b 

the  theoretical  development  of  several  modern  spectral  estimation 

techniques  (cf.  HAYKTN  [1979])-   These  techniques  seek  a  certain 

extension  of  C   to  a  covariance  sequence  C  =  {c.  :  t  =  0,  1,  ...}. 
s  ° 


"Hie  set  of  all  covariance  extensions  of  C   can  be  described  by- 
several  alternative  approaches  that  we  shall  recapitulate  in  Chapter 
II.  However,  theoretical  as  well  as  practical  interest  lies  with  a 
certain  subclass,  the  rational  ones. 

A  sequence  C  =  {c  :  s  «  0,  1,  ...)  is  called  rational  iff  there 
exists  an  integer  v  such  that  the  rank  of  the  behavior  (Hankel)  matrices 

B  :=  [c.,   n]f   . 
s     t+u-1  t,u=l 

satisfies  rank  B  <  v  for  s  =  1,  2,  ....   The  smallest  such  v  will 
s  — 

be  called  the  dimension  of  C. 

Rationality  is  directly  related  to  existence  of  finite  dimensional 
stochastic  realizations  of  C.   The  dimension  of  C  is  then  precisely 
equal  to  the  minimal  dimension  for  the  corresponding  state-space 
(see  for  example  FAURRE,  CLERGET  and  GERMAIN  [19/78]).  Moreover,  in 
case  C  is  a  rational  sequence  there  exists  a  finite  positivity 
test. 

In  the  case  of  unconstrained  rational  extensions  of  a  partial 
sequence,  called  partial  realizations,  a  minimal  dimension  can  be 
found  by  testing  linear  dependence.   In  case  the  minimal  dimension 
partial  realization  is  not  unique,  this  set  is  parametrized  by  a 
linear  space.   These  concepts  have  given  rise  to  the  elegant  partial 
realization  theory  of  KALMAN  [1979].  In  the  case  where  the  extension 
is  also  required  to  satisfy  the  covariance  property  the  problem  becomes 
substantially  more  involved  (see  KALMAN  [I98I]). 

The  purpose  of  this  dissertation  is,  in  broad  terms,  to  elucidate 
the  relation  between  rationality  and  positivity.  The  main  goal  is  to 
unveil  seme  of  the  issues  and  the  nonuniqueness  involved  in  extending 
the  partial  data  C   to  a  rational  covariance  sequence  C,  paying 

B 

special  emphasis  on  the  dimension  of  these  extensions.  We  believe  that 
we  are  reasonably  successful  and  that  certain  of  our  results  can  be 
profitably  considered  in  the  applied  area  of  identification. 


We  now  give  a  brief  description  of  the  contents  of  each  chapter. 
More  detailed  introductory  remarks  are  provided  at  the  beginning  of 
each  chapter. 

Chapter  II  is  devoted  to  a  review  of  certain  classical  techniques 
and  concepts  that  are  directly  related  to  the  covariance  extension 
problem. 

In  Chapter  III  we  use  the  algebraic  machinery  developed  in  Chapter 
II,  to  study  rational  covariance  extensions.  It  turns  out  that  a 
certain  polynomial  is  intimately  related  with  the  extension  and  can 
be  chosen  arbitrarily.   This  polynomial,  that  we  call  the  dissipation 
polynomial,  represents  the  zeros  of  the  power  spectrum.  We  found 
that  the  dissipation  polynomial  determines  in  a  precise  way  the 
asymptotic  behavior  of  some  important  sequence  of  parameters  that  is 
associated  to  a  covariance  sequence.   In  order  to  obtain  this  result 
we  developed  a  new  technique  for  spectral  factorization. 

In  Chapter  IV  we  develop  a  new  approach  that  is  most  suited  for 

describing  the  covariance  extensions  of  dimension  bounded  by  the 

number  of  data.   In  point  of  fact,  in  a  large  number  of  cases  this 

dimension  coincides  with  the  minimal  dimension.   The  merit  of  this 

approach  lies  also  with  the  fact  that  it  provides  a  novel  topological 

proof  of  a  certain  classical  result:  the  positive  definiteness  of 

the  quadratic  form  associated  with  C   is  sufficient  for  the 

s 

existence  of  covariance  extensions.   The  key  result  of  this  Chapter 
further  shows  that  an  essential  nonuniqueness  in  this  partial  realiza- 
tion problem  is  best  described  in  terms  of  the  associated  dissipation 
polynomials. 

Chapter  V  extends  some  of  the  earlier  development  to  the  case 
of  matrix  sequences.  Finally,  in  Chapter  VI  we  discuss  the  relevance 
and  potential  of  the  above  in  modeling. 

The  initial  motivation  and  part  of  this  dissertation  grew  out  of 
a  joint  work  with  KHARGONEKAR  (GEORGIOU  and  KHARGONEKAR  [I982]).  Tn 
material  of  Chapters  II  and  III  is  based  upon  this  work. 
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We  close  this  introduction  with  a  few  words  on  notation  and 

standing  assumptions.   Throughtout  this  dissertation,  we  shall  work 

with  the  field  of  complex  numbers  C  :  C[  z]  will  denote  the  ring 

of  polynomials  in  z  with  coefficients  in  C  ;  C   [z]  will 

denote  the  ring  of  n  x  n-matrix  polynomials  in  z  ;  "  -  " 

denotes  complex  conjugation  and  if  p(z)  G  C[z]^  then  p( z)   denotes 

complex  conjugation  on  the  coefficients  of  p( z) .  We  shall  be  dealing 

with  both  infinite  sequences  C  =  {c  :  t  =  0,  1,  ...,  c  G  C  for 

t  >  1  and  c  G  R]  and  finite  sequences  C  :=  {c,  :  t  =  0,  1,  . . ., 
—         o=  st 

s,    c  G  C  for  t  =  1,  2,    ...,    s  and  c  G  R).  A  sequence  C  is 
said  to  be  positive  (resp.  nonnegative)  iff  the  Toeplitz  matrices 


]S 
Ls   L  t-u  t,u=o; 


T„  =  [c+_,J+    .  s  -  0,  1, 


where  we  define  c  i  .  :=  Ci  ,i,      are  positive  (resp.  nonnegative) 

definite  for  all  s.  A  partial  sequence  C   is  said  to  be  positive 

(resp.  nonnegative)  iff  T   is  positive  (resp.  nonnegative)  definite. 

s 
Thus,  a  sequence  C  is  a  sequence  of  covariances  of  a  stochastic 

process  if  and  only  if  C  is  nonnegative.  Finally  this  notion  of 

positivity  (resp.  nonnegativity)  will  be  denoted  by  >  0  (resp.  >  0). 


CHAPTER  II.   CERTAIN  CLASSICAL  APPROACHES 

The  purpose  of  this  chapter  is  to  introduce  certain  mathematical 
concepts  and  techniques  that  are  pertinent  to  the  covariance  extension 
problem. 

We  shall  begin  with  some  algebraic  aspects  of  the  theory  of 
orthogonal  polynomials  relative  to  the  unit  circle.  Toeplitz  matrices, 
of  the  same  type  as  the  ones  associated  with  the  covariance  function 
of  a  stationary  stochastic  process,  were  classically  considered  to 
induce  an  inner  product  on  the  space  of  polynomials.   The  special 
Toeplitz  structure  can  be  effectively  exploited  by  considering  a 
particular  orthogonal  basis.   This  gave  rise  to  the  theory  of  or- 
thogonal polynomials  of  SZEGO  [19393 •   Since  that  time  the  theory  was 
progressively  developed  by  many  researchers.  AKHIEZER  [1965], 
GERONIMUS  [1951*],  [1961]  and  GRENANDER  and  SZEGO  [1958]  have  given 
classical  expositions  on  the  subject.  It  was  early  recognized  that 
the  theory  of  orthogonal  polynomials  had  strong  connections  with  a 
prediction  problem  in  the  theory  of  stochastic  processes  (see 
GRENANDER  and  SZEGO  [1958,  p.  173]  or  the  survey  paper  by  KAILATH  [197^]). 
This  opened  up  areas  of  application  of  the  theory,  notably  in 
stochastic  problems,  spectral  analysis  and  autoregressive  modeling 
(see  the  book  by  HAYKIN  [19791  f°r  various  applied  and  theoretical 
aspects  on  these) .  Motivated  by  autoregressive  modeling  for  multi- 
variate stochastic  processes,  WHITTLE [  1963],  and  WIGGINS  and  ROBINSON 
[1965]  laid  the  first  pieces  of  a  theory  of  orthogonal  matrix 
polynomials.  A  number  of  researchers  have  then  pursued  this  line 
of  research.  We  mention  only  the  most  recent  works  of  YOULA  and 
KAJANJTAN  [1978],  MORF,VIEIRA  and  KAILATH  [1978]  and  especially 
DELSARTE,  GENIN,and  KAMP  [1978a]  that  have  given  a  rather  elegant 
account  of  the  theory  of  orthogonal  matrix  polynomials  on  the  unit 
circle. 

We  restrict  our  attention  to  the  scalar  case  and  in  Section  2  we 
give  a  concise  exposition  of  those  aspects  of  the  theory  that  we  con- 
sider to  be  relevant  to  the  covariance  extension  problem. 


The  theory  of  orthogonal  polynomials  is  connected  to  certain 
problems  in  analysis.  Various  aspects  are  discussed  in  AKHIEZER 
[1965],  AKHIEZER  and  KREIN  [1962]  and  KREIN  and  NUDEL'MAN  [1977]. 
In  particular  there  is  a  connection  with  a  certain  interpolation 
problem  that  is  equivalent  to  the  covariance  extension  problem. 
Both  solvability  conditions  and  a  parametrization  of  all  solutions 
can  be  obtained  by  the  classical  SCHUR's  algorithm.   The  machinery 
of  orthogonal  polynomials  can  be  used  to  provide  a  compact 
description  of  the  solutions  in  terms  of  a  linear  fractional 
transformation.  This  is  the  content  of  Section  3.  We  should 
finally  mention  that  a  similar  description  of  an  isomorphic 
problem  was  used  by  DEWILDE,  VIEIRA  and  KAILATH  [1978]  and  also 
DELSARTE,  GENIN  and  KAMP  [1979l« 

1.  Orthogonal  Polynomials:  An  Algebraic  Approach 

We  consider  an  infinite  sequence  C  =  [cg   :  s  =  0,  1,  ..., 

with  c   in  R  and  c   in  C  for  s  >  0}.  We  define  on  the 
o      =       s      =        — 

space  C[z]  of  polynomials  in  z  an  inner  product  by 

<Jo  V*'  sic  »/>  '■=  Jo  L   SVW 

This  inner  product  is  definite  if  and  only  if  C  >  0.  Whenever 
C  >  0  (resp.,  >  0)   then  the  above  inner  product  defines  a  norm 
(resp.,  semi-norm)  on  C[z]  that  we  shall  denote  by  ||-||.  We 
begin  by  discussing  separately  the  two  cases  of  interest:  first 
the  case  C  >  0,  and  second  the  case  C  >  0  but  not  >  0. 

We  now  consider  C  to  be  a  positive  sequence.   The  inner 

product  (•,  •>  is  now  definite.  We  apply  the  standard  orthogonal- 

ization  procedure  to  the  natural  basis   {z  :  s  =  0,  1,  ...J  of 

C[z]  to  obtain  an  orthogonal  (but  not  necessarily  orthonormal) 

basis  of  monic  polynomials   {$  (z)  :  s  =  0,  1,  ...}.   These  poly- 

s 

nomials  are  known  as  the  orthogonal  polynomials  (of  the  first  kind) 
associated  to  the  sequence  C,   and  are  given  by 


*0(z)  =  1, 


(1.1) 


•s(z) 


=  det 


"-1 


Cs-1  Cs-2 


■  s+1 


c 


/det  Tg_1,  s  =  1,  2, 


Since  ||«  (z)||2  =  (zS,  $  (z)),  it  follows  that 
s  s 


(1.2)    ||$  (z)||2  =  det  T  /det  T   ,   s  =  0,  1,  ..., 

s  s        S— -L 

where  det  T  ,  :  =  1. 

The  special  inner  product  structure  of  C[z]   induces  upon  the  set  of 
orthogonal  polynomials  certain  algebraic  identities  and  an  important 
parametric  description.  We  shall  now  discuss  these. 

Let  P  (z)  G  C[ z]  be  of  degree  s.  We  define  the  reverse  polynomial 

S        — 


ps(z)*  :=  z^z"1). 


From  (z  ,  $  (z))  =  0  for  t  =  0,  1,  ...,  s  -  1  and  the  Toeplitz 
s 

structure  of  the  inner  product  it  follows  that 

(1.3)   (z  ,  <D  (z)*)  =  0  for  t  =  1,  2,  ...,  s,   and  any  s  >  1. 


Since  <t>  (z)   is  a  monic  polynomial  of  degree  s,  we  can  write 
s 


s-1 

(i.io    •,(■)*-!-  ^50bs,tVz)^ 


for  some  scalar s  b   .  From  (1.3)  and  the  above  we  obtain 

S  •  X 
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0  =  (1,    z*t(z)>    -  bs  t(«t(s),    *t(z)>. 


Hence,      b      .  =  (l,    z$  (z)  )/||o   ( z)  ||        is   independent  of     s.      This   fact 

s  j  "t  "t        "0 

gives  rise  to  the  parameters 

rt+1  :=  (1,  zOt(z)>/||<j>t(z)||2,  t  =  0,  1,  .... 

These  parameters  are  known  as  the  SCHUR  parameters  of  the  sequence 
C.      From  (l.U)    we  now  obtain  the   (well  known)    recurrence  identities 

0s(z)    =   z*s_-l(z)    -  Tfy.j.(*)*> 
(1.5) 

•a(«)*-«B^L(«)*.rirta.1(«), 

for  s=l,  2,  ...  .  From  the  first  identity  we  obtain 

K(z)l'2  =  K-i(z)l12  -  ?s(Vi(z)*'  zVi(z)) 

and  also 

0  =  (zO^z),  *s-1(z)*>  -  rsIIVl(z)"2* 

Combining  the  two  we  obtain 

(1.6)        ||0s(z)l|2  =  (1  -    IrJ^H^^z)!!2,      s  =  1,   2,    ••'. 

This  shows  that  the  parameters  R  =  [r  :  s  =  1,  2,  . . .  }  satisfy 


s 


(1.7)   |r  |  <  1,  s  =  1,  2,  .... 


s 


These  conditions  (and  c  >  0)   are  equivalent  to  C  being  positive. 
In  fact  starting  from  the  parameter  sequence  R  with   |r.  |  <  1  for 
all  t,   and  c  >  0,   we  may  construct  a  corresponding  positive 
sequence.   This  correspondence  is  bijective.   Furthermore,  partial 


positive  sequences  C  =  (c,  :  t  =  0,  1,  . ..,  s,  with  T  >  0} 

So  s 

correspond  bijectively  to  pairs     (c  ,    R  )      where     c     >  0     and 
R     =   {r,    :    1,    2,    . ..,    s     with      |r    |   <  1     for  all     t}.      This  we 

S        w  Tj 

show  below. 

The  sequence  of  parameters  of  a  positive  sequence  C  is  given  by 


(1.8) 


rn    =  -   c./c  , 
1                 1      0* 

(-  1)S  det 

"Cl 
c 

0 

■ 
• 
■ 

c 

_    -s 

+2 

C2        ' 

r     =  -    J   (0)    = 
s                sv    ' 

Cl        * 

• 

c-s+r 

's-l 


'1  J 


/det  T   , 

5  ™  -L 


for  s  =  2,  3,  •  ••,  and  they  satisfy   |r  J  <  1,   s  =  1,  2,  •  •  • . 

Conversely,  starting  from  the  sequence  of  parameters  that  satisfy 
|r  |  <  1,  s=l,  2,  . ..,  and  c  >  0,  we  obtain  the  corresponding 
sequence  C  by  solving  (1.8)  for  c  : 

5 


<*•«       cs  ~  Vs  3b>  "    'rtft   +  <cl 


)T'1 
■1>   s-£ 


's-l 


for  s  =  1,  2,  •••.  The  above  is  valid  provided  det  T  0i   0.   But 
this  follows  from   |r  |  <  1  for  t  =  1,  2,  ...,  and  the  algebraic 
identity 


det  T 

det  Tt-1  =  (1  "  'rt^ 


det  T,  '  "  x'   d>    '"' 


(which  arises  from  (1.2)  and  (1.6)).  Hence,  (1.8)  and  (1.9)  establish 
the  required  bijective  correspondence. 

We  now  discuss  the  singular  case  of  nonnegative  sequences  that  are 
not  positive.   Such  a  sequence  is  called  singularly  nonnegative. 
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Assume  that  C  ^  {0,  0,  ...)   is  a  singularly  nonnegative  sequence 
and  let  s  be  the  smallest  (positive)  integer  for  which 

det  T  =  0. 
s 

The  partial  sequences  O.(z)  :  t  =  0,  1,  . ..,  s)  and  R   are  defined 
as  earlier  and  (l.l)  -  (l.6)  hold  for  t  =  1,  ...,  s.  However,  we  now 

o 

have      ||$  ( z)  |!     =0     and     R       satisfies 
s  s 

(1.10)  |r.  |  <  1,      t  =  l,   2,    ...,    s  -  1,     and      |r    |   =  1. 

t  s 

The  interesting  feature  of  this  singular  case  is  that  any  singu- 
larly nonnegative  sequence  C,  as  above,  is  rational  and  uniquely 
determined  by  C   (or,  equivalently,  by  cq  and  Rg) .  Also  any 
partial  sequence  C   with  T  >  0  and  det  T,  =  0  /  det  T^ 
admits  a  uniquely  defined  singularly  nonnegative  extension  C. 
We  now  prove  these  facts. 

Let  C  be  singularly  nonnegative  and 

/  \     s      s-1 
X(z)  =  z  +  a.z    +  ...  +  a 
1  s 

be  a  monic  polynomial  of  least  degree  that  satisfies   ||x(z)||'"  =  0. 
Evidently,   s  is  the  smallest  (positive)  integer  such  that  det  T  =  0. 

5 

Furthermore,  X(z)  =  <*>  (z). 

Clearly,   jjz  X(z)||  =  0  for  all  t  >  0.  By  the  fact  that  Tg+t  >  0 
it  follows  that 

(0  ...  0   ag  ...  &1   1)' 

t 

is  a  zero- eigenvector  of  T      and  therefore 

s+t 

(1.11)  c    =  -  a,c    ,-...-  a  c  +  for  t  >  0. 

-s-t     1-s-t+l        s  -t        - 

This  shows  that  C  is  a  rational  sequence  and  is  in  fact  uniquely 
determined  from  the  partial  sequence  C  . 
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We  now  let  C   be  such  that  T,  >  0  with  det  T\  =  0.  We  shall 

^  z  —  t 

show  that  there  exists  a  nonnegative  extension  C  of  C   which  by  the 
above  discussion  is  unique. 

■Die  partial  sequence  Ct  defines  in  the  obvious  way  a  semi-norm  and 
an  inner  product  on  the  space  of  polynomials  of  degree  less  than  or  equal 
to  t.  We  denote  these  by  |J.||t  and  (' ,  -\     respectively.  Consider  now 
s  to  be  the  smallest  integer  for  which  det  T  =  0  and 

w  >    s     s_1  s 

x^z;  -  z  +  axz    +  ...  +  ag  be  a  monic  polynomial  of  least  degree  that 

satisfies  ||x(z)||2  =  0.  Precisely  as  we  did  before  we  now  obtain  that 

(^   c_s_u=  -  aic.s-u+r  •••  -  V-u  for  u  =  °*  *>  •••>  t  - s- 

We  now  extend  the  partial  sequence  c   to  an  infinite  one  C  using 
(1.12)  for  u  s  t  -  s  +  1,  ...t  We  now  show  that  C  >  0. 

For  any  a(z)  in  £[z]  denote  by  a  mod  X  the  remainder  of 
a(z)  divided  by  x( z) .  Since  (zU,  x( z) >  =  0  for  all  u  >  0  it 
follows  that 

(a(z),  a(z))  =  (a  mod  x,  a  mod  x) 

=  (a  mod  X,  a  mod  x) .  >  0. 

Iherefore  C  >  0. 

The   above  considerations  readily  solve  the  covariance  extension 
problem:  Given  a  partial  sequence  C  ,  there  exists  a  nonnegative 
extension  C  of  C   if  and  only  if  C  >  0.  In  particular,  the 
following  two  cases  are  possible: 

(a)    Nondegenerate  case:   C  >  0. 

In  this  case  the  set  of  all  nonnegative  extensions  of  C 

s 

are  in  bijective  correspondence  with  sequences  of  parameters 

R  that  are  either  finite  and  of  the  form  R={r:  t=s+l 

...,  s  +  u,  with  Jr.  |  <  1  for  t  <  s  +  u  and   |r   1=1) 

z  '   s+u '    ; 

or  infinite  satisfying   |rt |  <  1  for  t  =  s  +  1,  . . . . 
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(b)    Degenerate  case:  C  >  0  but  C  }   0. 


s  -         s 
In  this  case  there  exists  a  uniquely  determined  nonnegative 

extension  C. 

We  now  proceed  to  consider  certain  related  mathematical  objects, 
which  will  be  useful  in  the  next  section  in  showing  the  connection  of  the 
above  with  an  interpolation  problem. 

Define  the  power  series 

r(z)  :=  c  +  2.Z.  c,z  . 

v  '     o    t=l  t 

The  function  theoretic  properties  of  r(  z)  will  be  described  in  the  next 
section.    Here  we  view  r(z)  as  an  algebraic  object.  We  shall  now 
recall  the  notion  of  partial  realizations  (see  KALMAN  [1979])  anci  then 
introduce  the  so-called  orthogonal  polynomials  of  the  second  kind  of  C 
by  considering  certain  partial  realizations  of 


f(z_1)  =  Co  +  2Jl  C-tZ_t* 

Consider  a  formal  power  series  F(z  )  (in  negative  powers  of  z) . 
A  pair  of  coprime  monic  polynomials  (7r(z),  X(z))   or,  equivalently,  the 
rational  function  7r(z)/x(z)   is  said  to  be  a  partial  realization  of 
F(z"  )  of  order  s  iff 

[F(z-1)x(z)zS-de^]+  =  7r(z)zS-de^ 

ere  [  ]   denotes  "the  polynomial  part  of".  Equivalently,  the  rational 


wh 


function  7r(z)/x(z)   is  a  partial  realization  of  F(z"  )  of  order  s  if 
and  only  if  the  Laurent  series  tt(z)/x(z)  (with  the  division  carried  out 

in  the  field  of  formal  Laurent  series  in  negative  powers  of  z)  matches 

-1  -s 

F(z  )  up  to  and  including  the  coefficient  of  z 

We  now  consider  the  power  series  r(z  )  and  define  a  sequence  of 

polynomials  by 
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ff(i)  :=c-  [fiz~\3(z)*\+} 


where  $  (z)   is  the  s-th  orthogonal  polynomial  of  the  sequence  C. 
Die  integer  s  runs  over  either  all  nonnegative  integers  or,  a 
finite  number  of  them  depending  on  whether  C  is  positive  or  non- 
negative,  as  we  discussed  earlier.  These  polynomials  are  known  as 
the  orthogonal  polynomials  of  the  second  kind  of  the  sequence  C  and 
were  introduced  by  GERONIMJS  [I96I,  p.  10].  From  the  definition  of 
Y  (z)  we  have  that  c  H   (z)/<J>  (z)   (though  not  necessarily  a  coprime 

s  u  s       s  .. 

representation)  is  a  partial  realization  of  f ( z~  )  of  order  s.  In  the 
case  where  C  is  singularly  nonnegative  and  s  is  the  smallest  integer 
for  which  det  Tg  =  0,   it  follows  that  f(z"  )   is  actually  equal  to 

c  ¥  (z)/<i>  (z). 

o  s     sv  ' 

We  now  show  that  the  orthogonal  polynomials  of  the  second  kind 
satisfy  the  following  recurrence  identities  (which,  except  for  a  sign 
change,  are  the  same  as  ( 1. 5) ) : 

¥s(z)  =  zfs   x(z)  +  rs*s  1(z)*, 
(1.13) 

Ts(z)^  Vl(z)*  +  rszVl(z), 

for  s  =  1,  2,  ...  (or  a  finite  index  sequence  in  case  C  is  singularly 
nonnegative) . 

We  define  the  transformation 


-,  .  CO 

f:  C[z]  -*C[z]:  A(z)  m^[A(z)(co  +  2^  c_tz_t)]  +. 


We  also  define  a  sequence  C  via  the  relation 

(co  +  2t?l  c-tZ'  ^Co  +  2tSl^.tZ"  >  =  X> 
and  the  transformation 
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f:    C[z]  -*C[z]:   A(z)  ^^[A(z)(co  +  2^  c_tz~  )]  +  . 


/\  /K 


It  is  straightforward  to  check  that  ff  =  ff  is  the  identity 
transformation. 

We  now  modify  our  earlier  notation  by  adding  a  subscript  to 
Toeplitz  inner  products  (and  norms)  that  specify  the  defining  sequence. 
Thus  we  shall  have  (.,  •)    ,    (.,  . )£,   and  if  we  define  I  :=  {1,  0,  0,  . . .} 
then  we  shall  also  write  (•,  •)  . 

We  denote  by  g*  the  adjoint  of  the  transformation  g.  We  now 
have  that 

(',  ')c  =  (-,  |(f  +  t*)')z, 

and  also 

(f-,  f.)c  =  (.,  |f*(f  +  f*)f.)I  =  (.,  |(f*  +  i)')T  =  <•,  •>£. 

Since  jjf •  j|  =  ||«|k  is  certainly  a  semi-norm,  it  follows  that  C  is 
nonnegative. 

Since  the  polynomials  ¥  ( z) ,  s  =  0,  1,  . . . ,  were  defined  by 

s 

¥  (z)  : =  fO  ( z) ,  s  =  0,  1,  ...,  they  are  the  orthogonal  polynomials  of 

s        s  * 

the  first  kind  of  the  sequence  C.   Therefore  they  satisfy  relations  of 

the  type  (1.5) •   In  order  to  establish  the  precise  form  (1.13)  of  these 

relations  we  only  need  to  show  that 

(1.U0  *s(o)  =  -  fg(o). 

From  the  definition  of  ¥  ( z)  we  have 

sx 


,00  , 


The  constant  term  of 
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s;"8^  •-*"*>♦.<■>  *♦ 


equals  (2/c  )(l,  <J>  ( z) )  =  0.  Therefore  (  l.lU)  holds  and  hence  (1.13) 
o      s 

follows . 

We  finally  want  to  indicate  another  algebraic  identity  that  is 
satisfied  by  the  two  types  of  orthogonal  polynomials  that  we  shall 
refer  to  later  on: 

(1.15)  0g(zhs(z)*  +  *s(z)*s(z)*  =  2zShg, 

where  h   is  a  scalar  given  by 
s 

(1.16)  hs  :=  Jx(l  -  |rt|2)  -i  lks(z)||2. 

This  identity  follows  from  (1.5)  and  (1.13)  using  induction  on  s. 
2.  Interpolation:  A  Function  Theoretic  Approach 

Consider  the  following  interpolation  problem:  We  are  given  two 
regions  G   and  G   in  the  complex  planes  of  the  variables  z  and 

Z  W 

w,   and  a  set  of  pairs  (z  ,  w  )   with  zo   in  G   and  w   in  G 
'  e  v  a  'a  a      z       aw 

for  all  a  in  a  certain  index  set  I.  It  is  required  to  find  a  function 
F( z)  holomorphic  in  G   with  values  in  G   that  satisfies  the 
interpolation  constraints 

F( z  )  =  w   for  all  a  in  I. 
v  a'    a 

When  certain  of  the  points  z    coincide,   then  the  interpolation 
constraints  are  modified  so  as  to  assign  at  these  points 
values  to  the  successive  derivatives  of  F(z). 

This  problem  is  classical  and  a  number  of  techniques  have  been  applied 
to  it.   The  books  by  WALSH  [I956]  and  AKHIEZER  [1965]  give  comprehensive 
expositions  of  the  classical  approaches  to  the  problem.  In  recent  years 
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new  functional  theoretic  techniques  have  been  applied  that  also  extend 
to  a  more  general  class  of  interpolation  problems  that  includes 
interpolation  with  matrix- valued  functions.   These  techniques  have  been 
developed  in  the  work  of  SZ.-NAGY  and  FOIAS  [1970]  and  SARASON  [1967]. 

In  this  section  we  shall  consider  a  particular  case  of  the  problem 
which  is  directly  related  to  the  covariance  extension  problem.  We 
discuss  the  so-called  SCHUR's  algorithm  that  also  provides  a  description 
of  the  solutions,  and  we  tie  up  this  approach  with  the  material  of  the 
previous  section. 

The  following  classical  theorem  states  that  the  notion  of  positivity 
encountered  earlier  is  expressed  in  terms  of  a  function  theoretic 
property. 

(2.1)   THEOREM  (see  AKKEEZER  [1965,  p.  178]).   The  power  series 

r(z)  :=  c  +  2c,  z  +  . . .  +  2c  z  +  ... 
1  s 


converges  in   | z |  <  1  and  has  Re  r( z)  >  0  for  all  z  in   |  z |  <  1 
if  and  only  if  the  sequence  C  =  (c  :  s  =  0,  1,  ...,  with 
c  :=  (c  +  c)/2)  is  nonnegative. 

The  functions  possessing  the  above  property  form  the  so-called 
class  C.   (This  same  property  is  known  in  the  engineering  literature  as 
positive  realness.  See  for  example  BELEVITCH  [I968,  p.  71].) 

We  shall  consider  the  following  interpolation  problem:  Given  a  partial 
sequence  Cg  =  [ct  :  t  =  0,  1,  . . . ,  s  }  find  the  necessary  and  sufficient 
conditions  for  the  existence  of  a  function  in  C  whose  power  series 

expansion  in  z  begins  with  c  +  2c.z  +  ...  +2c  zS.  Also,  it  is 

— ~^~~~ ~~ ~~       o±  s  ' 

required  to  describe  the  set  of  all  solutions. 

This   is  known  as  the  CARATHEODORY  problem.      In  view  of  Theorem  (2.1) 
it  is   seen  to  be  equivalent  to  the  covariance  extension  problem. 
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Below  we  proceed  to  discuss  the  so-called  SCHUR's  algorithm  as 
applied  to  the  CARA1HE0D0RY  problem.   This  technique  provides  a  para- 
metrization  of  the  solutions  in  terms  of  functions  in  class  C. 

The  main  technical  result  needed  is  the  following  simple 

C 
.(ft, 


(2.2)   LEMMA.   The  function  r  ( z)   belongs  to  C  and  has  power 
series  expansion  in  z  that  begins  with  1  +  2c^   z  if  and  only  if 
one  of  the  following  two  conditions  holds: 


(a)     |c^a) I  <  1  and 


da(z)ra(z)  "  ba(z) 


VZJ  !=  -  c  (z)r  (z)  +aQ(z) 


aN   ax  '    a 


.(a). 


is  in  C  where  a(z)  :»  (1  +  z)(l  -  ci  )9 

ba(z)  :=  (1  -  z)(l  -  c[a)),  Cft(z)  :=  (1  -  z)(l  +  c[a)), 
and  dft(z)  :=  (1  +  z)(l  +  c[a)), 


1  +  c<*> 
(b)    |eJ"J|  =  1  and  r  ( z)  = 


(a)  I  _  1   .»„.*   r>  t„\ 1 


(a) 

1  -  c^   z 

INDICATION  OF  THE  PROOF.   The  set  of  functions  S(z)   that  are 
analytic  in   |z|  <  1  and  satisfy   |s(z  ) |  <  1  for  all  z   in   |z|  <  1 
forms  the  so-called  class  S.  There  exists  a  simple  relation  between 
functions  of  class  C  and  functions  of  class  S:  r(z)   is  in  C  if 
and  only  if 


(2.3)   5(Z)  ,ig«)  -m 

K  J      2  r(z)  +rToT 


is  in  S. 


For  functions  of  class  S  it  is  easier  to  show  an  analogous 
statement  (see  AKHIEZER  [I965,  p.  101]):   A  function  S  (z)   is  in  S 
if  and  only  if  one  of  the  following  two  conditions  holds : 
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(a')    |S  (0)  |  <  1  and 

S  (z)  -  S  (0) 

s  (z)  :-|   a  _» 

is  in  C, 
(b')   S   is  constant  of  modulus  equal  to  one. 
Applying  now  (2.3)  to  the  above  statement  proves  the  lemma.   □ 

In  point  of  fact  this  lemma  gives  a  description  of  all  functions 
in  C  in  terms  of  certain  parameters:  Beginning  with  a  function 
r(z)  :=  r,  (z)  =  1  +  2c!j   z  +  ...,  we  iterate  the  formula 

dt(z)rt(z)  -  bt(z) 

(2.k)      rt+1(z)  =.Ct(z)rt(z)  +at(z)  ' 

for  t  =  1,  2,  ...,  while   |c^  |  ^  1.   Then,   r(z)   belongs  to  C 
if  and  only  if  one  of  the  following  two  cases  holds: 

(a)  |c^  |  <  1  for  all  t, 

(b)  |<V*'  |  <  1  for  t  =  1,  ...,  s  -  1  and 

rs<z>=: — hr  "ith   14  I  = 1- 

l  -  c:  z 

(See  also  AKHIEZER  [I965,  p.  10J].)   The  parameters  p  :=  c!|   , 
t  =  1,  2,  ...  are  called  SCHUR  parameters  of  r(  z) . 

The  above  lemma  readily  solves  the  CARATHEODORY  problem:   Given 
the  partial  C  =  (1,  c  ,  ...,  c  }  define  c\        :  =  c  ,  t  =  1,  ...,  s. 
By  the  lemma  a  function  in  C  exists  having  power  series  expansion  that 


*2cW  +...  +2c(^zS 


begins  with  1  +  2c!;   +  ...  +  2cv  yz   if  and  only  if  either 

s 


19 


|c^  1  =  1  and  c[l]    =  (4l))t  for  t  =  2,  ...,  s 


or 


Icf  I  <  1 

and  there  exists  a  C-function  with  power  series  that  begins  with 

l+2c<2>z+...  +2c(2LS_1 
1  s-1 

where  c*   ,  t  =  1,  ...,  s  -  1  are  obtained  via  the  formula 

a1(z)(l  +  2cPz  +  ...  +  2c^  zS)  -  b^z) 
-  c1(z)(l  +  2c[1}z  +  ...  +  2c^zS)  +  d^z) 

=  1  +  2c$2)z  +  ...  +  2c(2JzS"1  +  0(zS) 
1  s-1       v  ' 

(where  the  division  is  carried  out  in  the  field  of  formal  Laurent  series 
in  positive  powers  of   z) .  In  this  way  the  problem  can  be  transformed  to 
an  equivalent   one  with  one  interpolation  constraint  less.  This 
inductive  procedure  is  known  as  the  SCHUR's  algorithm.   Iterating  the 
above  we  obtain: 

Ihe  CARATHEODORY  problem  is  solvable  in  precisely  the  following  two 
cases: 

(a)    Nondegenerate  case:  |c£  ' |  <  1  for  t  =  1,  ...,  s. 

In  this  case  the  general  solution  is  nonunique  and  is  obtained 
from 

at(z)IVi(z)  +  Vz)> 


^       r«<'>  -  sfoCTirnfr) 


for  t  =  s,  s  -  1,  ...,  1  and  r    an  arbitrary  function  in  C. 
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(b)    Degenerate  case:   |c£  '  |  <  1  for  t  =  1,  . . . ,  u  -  1,  with 
u  <  s,  |4U)  |  =  1  and  C[U)  -  (c[u))t  for  t  .  1,  ..., 
s  -  u  +  1.  In  this  case  the  solution  is  unique  and  is 
obtained  from  (2.5)  iterating  for  t  =  u  -  1,  ...,  1  with 


z 


1  +  .M 

1  -  cv  'z 

The  property  that  a  function  r(z)  belongs  to  C  is  described  in 
terms  of  the  parameters  pt  :=  e*  >    t  =  1,  2,  ...,   and  also  in  terms  of 
the  parameters  r,,  t  =  1,  2,    ...,      that  occur  in  the  recurrence  rela- 
tions of  the  orthogonal  polynomials  of  a  corresponding  (by  the  Theorem 
(2.1))  sequence.   These  two  sets  of  parameters  turn  out  to  be 
equivalent.   In  the  rest  of  the  section  we  shall  show  this  which 
gives  the  precise  connection  of  the  SCHUR' s  algorithm  with  the  material 
of  the  previous  section. 

We  first  prove  the  following: 
(2.6)   LEMMA.   Let  R*  :=  {r  :  |r  |  <  1,  s  =  t,    t  +  1,  . . . }  be  a 

S       S  ' 

sequence  of  parameters  and  (¥*(z),  0t(z),  s  =  0,  l,  ...}  denote 
the  associated  orthogonal  polynomials.  Define 

A*(z)  :=  !*(«)  +  fj(a)»,  B*(z)  :  =  fj(«)  -  ?*(«)*, 

C*  :=  »*(z)  -  »*(z)*,  D*(z)  :=  **(*)  +  **(«)*,  and 


B^(z)' 


D^z) 
sv 


The  following  algebraic  identity  holds: 


21 


*L(Z)\     ,.    .    /*TS(z) 


(2.7)    I  fU      =  M*(«)  , 

PROOF.  We  apply  induction  on  u.  For  u  =  0,   (2.7) 
obviously  holds.  Assuming  that  it  holds  for  u  =  v  we  obtain 

'*s+v+i<*>\    „t,  yCH.     a  o\..t,  ,.KS^* 


^('  L  r-{  •°K(i)" 


>  x  ^Jz)/  \<S>       (z)/  \<j>       (z)* 

S+V+l  V  V 

where  applying  *  on  M  ( z)   simply  means  to  apply  *  on  the  entries 

of  M*(  z) .   But 
sv 


(I  _IW**  =  <(<  A) 


We  finally  obtain 


•*   ,(z)/        US+^(z) 

k  s+u+lv  V        \  u+lv  y 


which  completes  the  proof.   □ 


In  the  case  where  R   is  a  finite  sequence  {r  :  s  +  1,  ...,  v, 

s 

with   |r  |  <  1  for  s  <v  and   |r  |  =  1}  then  (2.7)  still  holds 

S  V 

for  1  <  t  <  v,  0  <  s,  0  <  u,  and  s  +  t  +  u  <  v. 

Let  now  V   ( z)  be  the  functions  in  C  with  F   (0)  =1  that 
correspond  through  (1.9)  and  Theorem  (2.1)  to  the  parameter  sequences 
R   that  we  defined  in  the  lemma.  We  shall  show  the  following: 

(2.8)   PROPOSITION.   Provided   |r  |  <  1  for  u  =  1,  ...,  s  +  t, 
then  the  following  two  identities  hold: 
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A*(z)*rS+t(z)  +  B*(z)* 

(2.9)   r*(z) 


c*(z)*rs+t(z)  +  D*(z)*  ' 


s+t    n%)*r\z)   -  b*(z)* 

(2.10)  rs+t(z).^ , 5 

-c*(z)*rt(z)  +  aJ(z)* 


for  all  t  >  1,  s  >  0. 


PROOF.  We  first  consider  the  case  where  R  =  {r  :  s  =  1,  2, 

s 

. ..,  with   |r  |  <  1  for  all  s}  is  an  infinite  sequence.  We  shall 
s 

show  that  both  sides  of  (2.9)  have  the  same  power  series  expansion  in 
z.   (Both  polynomials  and  power  series  are  considered  as  elements  in 
the  field  of  formal  Laurent  series  in  z.) 

We  first  show  that  (Ct(z)*rS+  ( z)  +  D^z)*)"   exists.   Indeed, 

s  s 

the  coefficient  of  the  zero-term  is 

«*(())*  -  **(<))  +  **(())*  +  »*(0)  =2^0. 


(2.11) 


From  Lemma  (2.6)  we  have  that 

f*   (z)*  At(z)*HS+t(z)*/98+t(z)*   +  b^z)* 

S+Uv        s     u  v    '  u  v  sv  / 

*\  (  z)  *  Ct(  z)  *yS+t(  z)  */*S+t(  z)  *  +  Dt(  z)  * 

s+u        sv    u  v  '    '    u  v  '     sv 


Using  the  above  it  is  straightforward  to  show  that 


At(z)*rS+U(z)  +  B^z)*     I*  (z)* 
sv  sv  '       s+uv        _,  S+U+1N 

=  0(z     ), 


C^z)^rS+t(z)  +  D*(z)*    *L(a)* 


s+u' 

for  all  u  >  0.   By  the  definition  of  the  orthogonal  polynomials  of 
the  second  kind  we  also  have  that 

T*  (z)* 

r*(z)  .  Jg£ —  =  0(zs+u+1) 

*  \  (z)* 
s+uv  ' 
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for  all  u  >  0.   This  establishes  (2.9). 

In  the  case  where  R   is  a  finite  sequence  the  above  are 

still  valid  for  u  <  v  for  some  maximal  v  such  that   |r     1=1. 

-  '  s+t+v1 

But  then 

r*(«)  =  ^l*)*/*^*)*,      and 

rs+t(z)  -fj(«)  »/•*(«)*. 

Therefore,  by  (2.11),  it  follows  that  (2.9)  holds. 

The  identity  (2.10)  follows  from  (2.9)  when  solved  for 
s+t,  » 
r   (z)   provided  the  denominator  in  the  right  hand  side  of  (2.10) 

is  not  identically  zero.   This  we  show  below. 

From  the  definition  of  the  orthogonal  polynomials  of  the 
second  kind  we  have  that 

(2.12)  -  ^(z)*^)  +  **(z)*  -  0(zS+1). 

»  s 

From  the  above  and  (1.15)  we  obtain 

(2.13)  $*(  2)^(2)  +  **(z)  = 

b  s 

=  **(z)**(z)*  +  **(z)*f*(z))/^(z)*  +  0(zS+1) 

»      B  o        S         S 

.  t  s   _,  s+1. 
=   hg  z  +  0(z   ), 


where       hs      :=  JTjl  -    |rt+u  f)  .      By  adding  (2.12)    and  (2.13)   we  obtain 

c*(«)*r*(«)  +  aJ(z)*    -    hV  +  o(zs+1)  4  0, 

since       h       ^  0.       D 
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We  finally  show: 

(2.1U)   PROPOSITION.  If  r(z)   denotes  a  function  in  C  with 
r(0)  =  1  and  r.(z),  p .,  r  (z),  r   are  defined  as  before  for 
t  =  1,  2,  ...      (finite  or  infinite),  then  T,(z)  =  r  (z)   and 
p.  =  r,   for  all  t. 

PROOF.  We  apply  induction  on  t.   By  definition 
^(z)  =  r(z)  =  r  (z)  and  therefore  p  =  r  .   Suppose  T  ( z)  =  T   (z) 
for  some  t.   Then  p.  =  r   and  hence,   a  (z)  =  A..(z)*, 


bt(z)  =  B*(z)*,  c  (z)  =  cj(z)*,   and  d  (z)  =  D*(z)*,   as  well.  In 
case   |p  I  =  |r,  I  =  1  then  both  sequences  have  terminated  and  we 

are  done.   If   |p  |  =  |r  |  <  1  then  from  (2.9)  and  (2.10)  we 

t+1 
conclude  that  r,  ,(z)  =  r   (z).   □ 

(2.15)   REMARK.  As  we  mentioned  earlier,  interpolation  ideas  have  a 
strong  connection  with  circuit  theory.  For  example,  the  celebrated 
DARLINGTON  synthesis  procedure  is  the  analog  of  the  SCHUR's 
algorithm  for  solving  the  general  Nevanlinna-Pick  interpolation 
problem.   Several  of  these  connections  were  pointed  out  and  shown 
explicitely  by  DEWILDE,  VIEIRA,  and  KAILATH  [1978].   In  point  of 
fact,  in  that  paper  they  derived  a  compact  description  for  the 
solutions  of  a  SCHUR  interpolation  problem  that  is  similar  to  (2.9) 
(see  DEWILDE,  VIEIRA,  and  KAILATH  [1978,  p.  668]  and  also  DELSARTE, 
GENIN  and  KAMP  [1979,  p.  ko]) •   The  various  forms  of  interpolation 
can  be  interpreted  in  a  circuit  theoretic  framework  as  synthesis 
with  cascade  connection  of  coupling  networks.   In  the  same  framework 
the  linear  fractional  transformation  (2.9)  is  seen  to  correspond  to  a 

cascade  connection  terminated  to  a  resistive  network  with  impedance 

s+1 
r   (z)   (compare  also  with  BELEVITCH  [  I968,  p.  110]). 


CHAPTER  III.   RATIONAL  COVARIANCE  EXTENSIONS 

In  the  first  section  we  begin  by  applying  the  previously  derived 
interpolation  results  to  the  study  of  rational  covariance  extensions. 
Certain  bounds  for  the  dimension  of  the  various  extensions  are 
provided  by  this  algebraic  approach. 

With  any  rational  C-function  or,  equivalently  with  any  rational 
covariance  sequence,  there  is  associated  a  certain  polynomial  in  z 
and  z~  .   This  polynomial  we  call  the  dissipation  polynomial  of 
the  sequence.   It  represents  the  zeros  of  the  power  spectrum  or, 
equivalently,  the  zeros  of  an  associated  stochastic  realization. 
This  polynomial  is  completely  determined  up  to  a  scalar  factor  by  the 
tail  of  the  associated  parameter  sequence.  In  point  of  fact,  the 
dissipation  polynomial  up  to  a  scalar  factor  is  an  invariant  of  the 
action  of  "shifting  and  truncating"  the  corresponding  parameter 
sequence. 

This  rather  interesting  result  is  further  exploited  in  Section  h 
in  connection  with  asymptotic  properties  of  rational  covariance 
sequences.   The  most  complete  treatment  up  to  date  of  the  asymptotic 
and  analytic  properties  of  positive  sequences  and  of  the  associated 
orthogonal  polynomials  has  unquestionably  been  given  by  GERONIMUS  [I96I] 
We  shall  apply  some  of  his  results  to  the  case  of  rational  sequences. 
A  certain  new  aspect  that  emerged  does  not  seem  to  have  an  analogue 
in  the  general  case.   The  dissipation  polynomial  determines  the  asymp- 
totic behavior  of  the  parameter  sequence.   The  sequence  of  parameters 
of  a  rational  covariance  sequence  is  not  necessarily  rational;  however 
it  is  in  a  certain  precise  sense  very  close  to  being  so.  We  shall 
call  this  property  "almost  rationality. 

Another  aspect  of  this  development  is  a  new  algorithmic  procedure 
for  spectral  factorization.   This  is  a  key  problem  in  system  theory 
and  several  approaches  to  it  have  been  developed.   In  the  discrete- 
time  scalar  case,  given  a  rational  function  7r(z)/x(z),  with  tt(z), 
X(z)   in  C[z],  that  has  positive  real  part  almost  everywhere  on 
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|z|  =  1,   it  is  required  to  obtain  a  factorization 

2  J  X(z)   Xfz'1)  f    X(x)  X(z_1) 

with  ti(z)  £  C[z],   for  the  real  part  of  7r(z)/x(z)   on   |z|  =  1.   This 
factorization  amounts  to  factoring  a  nonnegative  trigometric  polynomial 

d(z,  z_1)  s»|   7T(z)x(z_1)  +  X(z)^(Z_1)  J  =  T1(z)n(z"1), 

z  =  e  ,   as  the  square  of  the  modulus  of  a  polynomial  tj(  z)  . 

The  existence  of  such  a  factorization  is  well  known.   The  most  common 
approaches  are  a  Riccati  based  approach  (see  FAURRE,  CLERGET,  and  GERMAIN 
[1978])  and  an  algorithm  due  to  RISSANEN  and  KAILATH  [1972].  For 
different  aspects  of  the  factorization  problem  see  ANDERSON,  HITZ  and 
DIEM  [1971*],  DELSARTE,  GENIN  and  KAMP  [1978b],  FRIENDLANDER  [1982],  SAEKS 
[1976],  STRINZIS   [1972],  and  YOULA  [I96I]. 

In  our  investigations  we  found  a  new  technique.  This  is  intimately 
related  with  the  above.  However,  it  operates  on  both  numerator  and 
denominator  of  a  C- function  f(z)/x(z)   instead  of  simply  the  dissipation 
polynomial. 

The  key  idea  is  based  on  the  invariance  of  the  dissipation  polynomial 
d(z,  z  )  under  the  action  of  "shifting  and  truncating"  the  corresponding 
parameter  sequence.  Under  this  operation,  certain  associated  rational 
C- functions  tend  to  1,  uniformly  on  compact  subsets  of   |z|  <  1. 
Consequently,  both  numerator  and  denominator  polynomials  tend  to  the  same 
polynomial,  which  turns  out  to  be  the  "stable  spectral  factor"  of 
d( z,  z  ) . 

3.  Rational  Covariance  Extensions  and  the  Dissipation  Polynomial 

A  key  result  in  partial  realization  theory  is  that  a  sequence 
C  =  [c  :  t  =  0,  1,  . . . }  is  rational  if  and  only  if  the  power  series 

r(z)  =  c  +2  Zcz 
0     t=l  t 
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defines  a  rational  function  in  z  (see  GANTMACHER  [1959,  Chapter  V]  and 
also  KALMAN,  FALB,  and  ARBIB  [ I969,  Chapter  10]).  Moreover,  if 
r(z)  =  tt(z)/x(z)  with  tt(z),  x(z)   coprime  polynomials  in  z,   then 

dim  C  =  max  (deg  7r(z),  deg  X(  z)  ) 
=  :  dim  r(z). 


The  previously  derived  description  for  the  solutions  of  the 
CARATHEODORY  problem  will  now  be  applied  for  the  study  of  the  rational 
ones.   Such  a  solution  with  data  a  partial  sequence  C   will  be  called 
a  pr  (positive  rational)  -  extension  of  C  . 

In  the  degenerate  case  where  C   is  nonnegative  but  not  positive, 

s 

there  exists  (see  page  10)  a  unique  covariance  extension  which  turns  out 

to  be  rational.   In  the  nondegenerate  case  where  C   is  positive, the 

s 

set  of  all  pr-extensions  is  described  in  the  following: 


(3.1)   THEOREM.   Let  C   be  a  given  partial  positive  sequence, 


s 


R  =  {r,:  t=l,  ...,  s)  be  the  associated  partial  parameter  sequence, 

and  M~ (z)   be  the  corresponding  matrix  polynomial  defined  in  Lemma  (2.6). 

An  irreducible  rational  function  c  TT,  ( z)  /x,  ( z) ,  with  tt,  ( z) ,  X,  ( z)  G 

C[z]  and  w   (0)  =  X,(0)  =  1,   is  a  pr-extension  of  C   if  and  only  if 

there  exists  a  unique  irreducible  rational'  C-function  it     ,  (z)/x     -,(z) 
- s+lv  ''    s+lv 

with  tt  ,.  (z),  X  ^,(z)  €  C[z]  and  w    .(0)  =  X  ,,(0)  =1,   such  that 
s+lx   '   s+lv     =    s+1      s+1         


(3.2) 


s+1 
Then,   R    -   ^r<3+i>  r  +p>    •  ••)  is  the  sequence  of  parameters  associated 

with  tts+1( z) /xs+1( z)   if  and  only  if  R1  =  (r^  ...,  rg,  rg+1,  ...]  is 

the  sequence  of  parameters  associated  with  tt,  (  z) /x,  (  z) .  Moreover,  the 

following  holds  : 


*•  Vl(g)  <  *•      Fl(z)  <=  «   Fs+l(z) 
dim r— r-  g  dim  -  ,   <.    S  dim 7— r 

Vi(z)  W  Vl^T 


+  s. 
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It  is  clear  that  any  continuation  (r.  :  |r,  |  <  1,  t  =  s  +  1,  ...) 
for  the  partial  sequence  R   leads  to  a  positive  extension  of  C  .   The 
positivity  is  effectively  characterized  in  terras  of  the  associated  sequence 
of  parameters.   This  is  not  the  case  with  the  rationality.  Due  to  the 
nonlinear  transformation  (2.9)  between  the  c's  and  the  r's,  the  para- 
meter sequence  of  a  rational  sequence  is  almost  never  a  rational  one. 
However,  the  interpolation  approach  shows  that  the  rationality  of  a 
covariance  sequence  is  completely  determined  by  the  tail  of  the  parameter 
sequence. 

PROOF.  From  (2.9)  and  (2.10)  we  readily  obtain  that  a  solution  r  (z) 


to  the  interpolation  problem  is  rational  if  and  only  if  the  C-function 
r   (z)  assoc: 
also  rational. 


s+1 
r   (z)  associated  with  the  continuation  of  the  parameter  sequence  is 


Let  P   (z)  =  ir     -  (z)/x  ,  (z) .  The   normalization  conditions 
f1(0)  =  X1(0)  =  1  and  tts+1(0)  =  X  +1(0)  =1  are  compatible  due  to  the 

fact  that 


We  now  derive  the  last  inequality  that  provides  bounds  on  the 
dimensions  of  various  pr- extensions.  We  first  define  the  matrix 
polynomial 


(3.3)   Njz)  :-§ 


DV(z)     -  BV(z) 

Uv  Uv  ' 


-  CV(z)       AV(z) 

Uv  Uv  ' 


for  v  =  1,  2,    ...,  n  =  0,  1,  ...,  with  A^(z),  B^(z),  c£(  z) ,  L^(z) 
defined  as  in  Lemma  (2.6).  Using  (2.15)  it  can  be  shown  by  direct 
calculation  that 
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1        0 

NV(z)*  MV(z)*  =   zV 
uv  uv  u  i 


f 


where 


v         v+u 


hv  :=  :nu(l-  \r.n 

u         t=vv  '   t '    ' 


Applying  this  to  our  case  we  have 


Vi<  z> 


'    =  **)* 


h   z 
s  s 


Since  the  elements  of  N  (z)*  are  polynomials  of  degree  s,  the  above 

s 

implies  that 

deg  Xs+1(z)  <  deg  X1(z) 

and  also 

deg  ^s+l^ ^   -  deg  Wl(  ^  ' 
From  (3«2)  we  also  have  that 

deg  Xx(z)  <  deg  Xg+1(z)  +  s 

and  similarly 

deg  Wjiz)   <  deg  tts+1(z)  +  s. 

These  prove  the  last  inequality  in  (3.1).   □ 

We  now  consider  an  irreducible  rational  C- function  7r(z)/x(z). 
The  real  part  of  tt(z)/x(z)  is  nonnegative  for  all  z  on   |z|  =  1  where 
it  is  defined.   Therefore, 
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7r(ej0)x(e-]e)  +  7r(ed9)x(eJe)>  0 


for  all  9  in  [  -  w,   tt].  Following  the  terminology  of  an  unpublished 
report  by  KALMAN  we  shall  call 

d(z,  z"1)  :=|  (tt(z)x(z-1)  +^(z-1)x(z)} 

the  dissipation  polynomial  of  7r(z)/x(z).   By  slight  abuse  of  terminology 
we  shall  also  call  a  dissipation  polynomial  any  polynomial  p( z,  z"  ) 
in  both  z  and  z  ,  which  for  z  =  expje  and  all  6   in  [-tt,  w]     is 
nonnegative.  Finally,  let  us  define  the  degree  of  d(z,  z  )   as  the 
largest  power  of  z. 

The  role  of  the  dissipation  polynomial  in  the  context  of  stochastic 
processes  will  be  discussed  in  Remark  (3.8).  Herein,  we  shall  see  that 
the  dissipation  polynomials  associated  to  the  various  pr-realizations 
of  C   are  up  to  a  scalar  factor  determined  completely  by  the  choice  of 
the  C- function  r   (z)  =  w  +1(z)/x  +1(z)  of  the  previous  theorem. 

Let  r(z)  =  c  IT.  ( z)  /x,  ( z)  be  a  rational  C- function  and 
-.  o  J-     -L  ~ 

R  =  {rs  :  s  =  1,  ...)  denote  the  associated  parameter  sequence.  Let 

also  R  =  {r  :  s  =  t,  t  +  1,  . . . }  denote  the  usual  "shifted  and 

s  i 

truncated"  parameter  sequence  and  tt,(z)/x  (z),  d  ( z,  z~  )  the  associated 

Tt  "C        "C 

rational  C-function  and  dissipation  polynomial.  We  now  present  the 
following: 

(3.^)   THEOREM.  In  the  degenerate  case  where 

R  =  [r  :  s  =  1,  2,  ...,  u,  with   |r  |  <  1  for  1  ^  s  ^  u 
and  Ir  1=1} 

we  have  that 

d  (z,  z"  )  =  0  for  t  =  1,  2,  ...u. 

In  the  nondegenerate  case  where 


31 


R1  =  {r  :  s  =  1,  2,    ...,      with   |r  |  <  1  for  all  s] 


we  have  that 

d,    -1,   ,ta   ,_  _-l, 


±(z,    z"x)  =  h£lt+1(z,  z  ),   for  t  =  1,  2,    .... 

The  behavior  of  the  dimension  of  x^>  z\      as  t  increases  is 
described  in 

(3.5)   PROPOSITION.   In  the  degenerate  case  where  u  is  as  in  Theorem 
(3.U)  we  have  that 

nt(z) 
dim  1   k    =  u  -  t  +  1,  for  t  =  1,    . ..,   u. 

In  the  nondegenerate  case  we  have  that  the  following  two  cases  are 
possible : 

TTt+1(z)  \(Z) 

(a)      dim  \3&  -  *"  x^T  ' 


TTt+1(  z)  Tt(  z) 

(b>      dim  xTTT^T  =  dim  xTTT  "  x' 


Furthermore,  case  (a)   is  equivalent  to  each  of  the  following  two 
conditions: 

rt(.) 


(a')   dimj-^y  =  dt(z,  z  ), 

TT  (  Z ) 

(a")   dim  ^y  -  deg  (tt^z)  +  Xt(z)). 


We  will  now  prove  (3.*0  and  (3.5) 
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PROOF  OF  (3.U).      In  the  degenerate  case  we  have 


VZ>    =*u-t+l(z)*> 


and 


VZ>    =  $u-t+l<z)*- 


From  (1.15)  we  obtain  dt(  z,  z'1)  =  hu.t+1-   since   lrJ  =  *»  lt  follows 


that 


In  the  nondegenerate  case  we  obtain  from  (1.15)   that 
dx(z,    z"1)    =\  {Tr^zH^z"1)    +f1(z-1)X1(z)} 

=  \  l^z)^"1)   +f1(Z-1)oJ(z)}{7rt+1(z)Xt+1(z-1)    + 

+  ^t+l(Z"1)Xt+l(z)) 


hl<WZ>    Z_1)-        D 


PROOF  OF  (3.5).  In  the  degenerate  case, 


and 


*t<»>-*l*«W#' 


for  t  -  1,  2,  ...,  u.  Also,   l**.t+1(0)  |-  l*u_t+1(°)  I  =  lrJ  =  1 
is  different  from  zero.   Therefore, 


33 


and 


deg  Xt(z)  =  deg  tt  ( z)  =  u  -  t  +  1. 

In  the  nondegenerate  case,  using  (2.k)   we  obtain 

z7rt+l(z)  =  f{7rt(z)  "  Vz))  +  z(7rt(z)  +  Vz))  }/(1  +  rt)f 

zXt+i(z)  =  i(Vz)  -  Ft(z))  +  z(Vz)  +  7rt(z))5/(i  -  rt)« 

This  shows  that  both  deg  ir.+-(z)  and  deg  X,+,(z)  are  less 
than  or  equal  to  max  {deg  ^(z),  deg  X,(z)}.  Moreover,  this  difference 
can  be  at  most  one.  Therefore  (a)  and  (b)  are  the  only  two  possibilities, 

In  the  case  where  max  [deg  X.( z) ,  deg  ir.(z)}  = 
deg  (Trt(z)  +  Xt(z)),  then  clearly  deg  7rt+1(z)  =  deg  Xt+1(z)  = 
deg  (^t(z)  +  Xt(z))  =  dim  wA  z)  /x,(  z) .  In  the  case  where  the  above  does 
not  hold, then  both  deg  7rt+1(z)  and  deg  Xt+1(z)  are  less  than 
dim  7Tt(z)/xt(z).   This  establishes  the  equivalence  of  (a)  and  (a"). 

Consider  now  the  identity 
|{7rt(z)  Xt(z_1)  +  ft(z_1)xt(Z)}  =  dt(z,  z"1) 

=  d<s)zS  +  ...  +d[0)  +  ...  +dis)z"S, 
V  t  t 

(s) 
where  we  assume  that  d;  ;  *  0.  It  is  easy  to  see  that 

-1 
deg  (7rt(z)  +  Xt(z))  =  deg  d  (z,  z"  ).  This  establishes  the  equivalence 

of  (a*)  and  (a").   □ 

In  view  of  the  above,  the  dissipation  polynomial  of  the  various 
pr- extensions  of  C   can  be  arbitrarily  chosen  by  appropriate  choice 


s 


of  the  C-function  tfg+1(z)/x   (z).  The  set  of  all  rational 

C- functions, which  have  dissipation  polynomial  fixed  up  to  a  scalar 

factor,  is  described  in  the  following  : 

(3.6)   PROPOSITION.  Let  d(z,  z"1)  be  an  arbitrary  dissipation  poly- 
nomial of  degree  s.  Then  for  any  polynomial  a(z)  such  that  a(z) 


5* 


and  zsd(z,  z  )  are  coprime  polynomials  there  exists  a  unique  rational 
C- function  r(z)  =  7r(z)/x(z)  with  r(0)  =1  and  such  that 

(3.7)   d(z,  z"1)  =  |{7r(z)x(z_1)  +  ^(z~1)x(z)} 

and 

7r(z)  -  X(z)  =  za(z). 

Conversely,  for  any  rational  C- function  r(z)  having  r{0)  =  1 
and  dissipation  polynomial  d(z,  z"  )  there  exists  a  corresponding 
polynomial  a(z)  as  above. 

PROOF.  Let  a(z)  be  any  polynomial  such  that  z  d(z,  z  )  and  a(z) 
are  coprime.  Then 

£d(  z,  z"  )  +  a(z)a(z"  ) 

is  a  dissipation  polynomial  which  is  zero  on   |z|  =  1.  Therefore,  this 
polynomial  factors  into  a  product  b(z)b(z~  )  where  b(z)  is  coprime 
with  a( z)  and  has  no  root  in  |  z  |  <  1. 

Consider  the  function  S(z)  :=  a(z)/b(z).  Clearly  we  have  that 

i-  is(*)i2  -I  aLsjj^.  >o, 

for  z  =  expje  and  6     in  [-  w,   tt].  Since  b(z)  has  no  root  in 
|z|  <  1  it  follows  from  the  maximum  modulus  principle  that  S(z)  is 
in  S.  Therefore  by  (2.3) 


,  N   b(  z)  -  za(  z) 
^z)  =  b(zj  I   za(z) 


is  in  S.  It  can  be  readily  checked  that  r(z)  has  dissipation 
polynomial  d( z,  z  ) . 

Conversely,  for  any  r(  z)  =  tt(z)/x(z)   in  C  where  r(0)  =  1 
and  (3.7)  hold,  a(z)  =  (tt(z)  -  x(z))/z  is  the  required  polynomial. 
This  is  shown  by  reversing  the  previous  argument.   □ 
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The  algebraic  approach  we  followed  in  this  section  gives  only  rough 
bounds  on  the  dimension  of  the  various  pr-extensions  of  C  .  For 
example,  given  any  dissipation  polynomial  of  a  certain  degree  u  we 
can  always  find  a  corresponding  C-function  of  the  same  degree.   Then, 
by  Theorem  (3.1)  we  can  obtain  a  pr- extension  with  dimensions  between 
u  and  s  +  u. 

In  the  next  chapter,  a  different  approach  will  be  followed.  It  will 
be  shown  that,  with  an  appropriate  choice  of  the  extension,  we  can 
always  achieve  dimension  equal  to  s.  Furthermore,  it  will  be  shown 
that  for  a  large  number  of  cases,   s  is  the  smallest  possible  dimension 
of  any  pr- extension. 

(3.8)   REMARK.   The  role  of  the  dissipation  polynomial  in  the  context 
of  stochastic  realization  will  be  now  discussed.  At  the  same  time, 
certain  quantities  that  will  be  used  in  the  next  section  will  now  be 
introduced. 

Consider  a  covariance  sequence  C  =  [c   :  s  =  0,  1,  ...}.   The 

s 

nonnegativity  of  C  or,  equivalently,  the  covariance  property  is  a 
necessary  and  sufficient  condition  for  the  existence  of  a  nondecreasing 
function  <x(©),  with  9     in  [-7T,  ir]     such  that 

IT 
X  / 

c 


t  =  ~  I  e~iteMe),  t  =  0,  +1,  +2, 


(see  AKHIEZER  [I965,  p.  180]) .   This  function  is  called  spectral 
distribution  (of  C,   or  of  a  corresponding  stochastic  process) .   The 
derivative  cr'(e)   of  cr(0)   exists  almost  everywhere  in  [-  7r,  tt] 
and  is  called  spectral  density. 

The  C-function  r( z)   associated  to  C  as  in  Theorem  (2.1)  admits 
the  following  integral  representation  (see  AKHIEZER  [1965,  P-  179]): 


(3.9)    n*)-^f  V^to(e) 


e 

-IT 


^6 


Our  interest  rests  in  the  case  where  C  is  also  a  rational  sequence. 
In  this  case  cr(fl)   consists  of  two  parts: 

(3.10)   cx(9)  =  a  (6)    +  a  (9), 
a      J 

where  a  (8)      is  an  absolutely  continuous  nondecreasing  function  and 
a 

cr.(e)   is  a  nondecreasing  function  with  finitely  many  points  where  the 
function  increases.  Furthermore,  the  derivative  cr'(e)   is  a  rational 
function  in  eJ0.  For  more  details  see  DOOB  [1953,  P-  5^2]  and 
GRENANDER  and  SZEGO  [1958,  p.  5]. 

The  decomposition  (3.10)  induces  via  (3*9)  the  representation 


w(z)  7Ta(z)    7T  (z) 


where     tt  (z)/x  (z)      is  a     C-function  with  the  property  that     X(z  )    *  0 
a,  a  ~  a     o 

for  all     z       in      |z|  <  1     and    7r.(z)/x.(z)      is  of  the  form 
o  '    '  —  3d 

7T.(z)        deg  Xj       exp(j9u)   +  z 

(5>12)      XT^"  =  ui.       pu  exp(j0  )    -   z 

J 

where  o   are  positive  scalars. 
Ku 

Let  d(z,  z"1),  d  (z,  z"  )   and  d.(z,  z"  )   denote  the  dissipation 
a  J 

polynomials  of  the  above  three  functions  ( in  the  obvious  notation) . 

From  (3.12)  it  immediately  follows  that  d  (z,  z"  )  =0.  Relation  (3.H) 

J 

now  implies  that 

(3.13)   d(z,  z"1)  =  d  (z,  z_1)x  (z)X  (z"1). 

A  stochastic  realization  of  C  is  a  dynamical  system  Z  that  under 
certain  stochastic  input  and  initial  states  generates  an  output  process 
v   that  realizes  C  via  the  covariance  function.  Any  stochastic 
process  y   can  be  decomposed  into  a  superposition  of  two  uncorrelated 
stochastic  processes 
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y   =  y     +  V  . 

where  v     is  the  so-called  purely  nondeterministic  part  and  y 

a, t  J>  T 

the  deterministic  part.  (This  is  called  the  Wold  decomposition.  For 
more  information  see  GRENANDER  and  SZEGO  [1958,  Ch.  10]  or  functional 
analysis  literature  where  it  has  been  widely  used,  e.g.,  HELSON 
[19614,  p.  10])] 

In  the  case  where  C  is  a  rational  sequence  then  the  above 
decomposition  is  in  correspondence  with  (3. 10).   The  part  y.    can 
be  realized  by  superposition  of  sinusoidal  signals  with  frequencies 
determined  from  the  roots  of  X.(z)  whereas  yo    can  be  realized  by 
a  single  input  system  having  white  noise  input  and  transfer  function 
T)a(z)/Xa(z)  where 

{3.1k)        da(z,  Z"1)  =  Tla(z)7la(z"1). 

The  relations  (3.13)  and  (3.11+)  indicate  the  role  of  the  dissipation 
polynomial  in  this  context. 

Returning  to  the  covariance  extension  problem  it  is  natural  to 
consider  factorizations  of  the  form  (3.13)  for  the  dissipation  poly- 
nomials of  both  7T1(z)/xi(z)   and  TTg+1(z) /Xg+1(z)   in  Theorem  (3-1)  • 
Whenever  both  parts  in  (3.10)  are  present  it  is  not  necessarily  true 
that  (in  the  obvious  notation)  X,  .(z)  =  X  ,  .(z).  Due  to  this  fact 

-L,  J         S+X,  J 

it  appears  that  formula  (3.2)  in  Theorem  (3.1)  is  simply  a  computational 
tool  and  does  not  seem  to  have  a  stochastic  interpretation. 

k.     Asymptotic  Properties  of  the  Spectral  Zeros 

We  begin  by  discussing  a  procedure  for  spectral  factorization.   This 
result  will  be  subsequently  used  to  elucidate  the  role  of  the  dissipation 
polynomial  on  the  asymptotic  behavior  of  the  sequence  of  parameters. 

Let  r  (z)  =  it,  ( z)  /x,  ( z)  be  a  rational  C- function  with  r  (0)  =1 

1 

and  R  =  {rs  :  s  =  1,  2,  ...}  the  associated  parameter  sequence.  We 

denote  by  R*  the  usual  truncated  sequences,  tt,(z)/x,(z)   the 
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associated  C- functions  and  d,(z,  z"1)   the  dissipation  polynomials, 

where  t  =  1,  2,  We  shall  consider  only  the  nondegenerate  case 

where  d  (z,  z"1)  ^  0.  In  this  case  by  a  well  known  factorization 
theorem  (see  GRENANDER  and  SZEGO  [1958,  p.  20])  there  exists  a  polynomial 
t)  (z),  with  T)  (0)  =  1,  and  a  positive  scalar  7±     such  that 

(k.l)        dx(z,  z"1)  =  71ti1(z)^1(z"  ). 

If  we  require  that  \(zo)    *   0  for  all  zq  in   |z|  <  1  and  also 
H.(0)  =  1,  then  both  7,  and  \\ _(z)  are  uniquely  determined.  This 
polynomial  r\  ( z)  we  call  the  stable  spectral  factor  of  d^  z,  z  ) . 

We  similarly  define  yt>   \(z)  >     From  Theorem  (3.U)  we  clearly  have 
that 

n^z)  =  \{*)t    for  t  =  1,  2,  ..., 

and  also 

We  now  set 

7rt(z)  .  1  +  a^z  +  ...  +  a^z3, 

and 

Xjz)  =  1  +  b,(t)z  +  ...  +  b(ot}zS. 
t  J-  s 

Clearly, 

(U.2)    rt=(a^  -b[t})/2, 

and  by  (2.k) 

(k.3)        7Tt+1(z)  =  l/2[(7Tt(z)  -  Xt(z))/z  +  (7Tt(z)  +  Xt(z))]/(1  +  rt), 
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(k.k)        Xt+1(z)  =  l/2[(Xt(z)  -  7Tt(z))/z  +  (7Tt(z)  +  Xt(z))]/(1  -  rt), 

for  t  =  1,  2,    Iterating  the  above  we  obtain  the  sequence  of  pairs 

(7rt(z),  Xt(z)),  t  =  1,  2,  .... 

The  following  theorem  states  that  (k.2) ,    (4.3),  and  {k.k)   provide  an 
algorithmic  procedure  to  obtain  T|(z). 

(4.5)   THEOREM.   Let  R1,  ^(z),  Xt(z),   and  ti(z)  be  as  above.   Then 

PROOF.  First  we  need  to  recall  certain  function  theoretic  results: 

Let  r(z)  be  a  C-function,  and  for  simplicity  assume  r(0)  *  1. 
Let  a*(e)  be  the  associated  spectral  density  function  that  is  given  by 

o£(8)  =  Re  r(ej9) 

a.e.  on  [-  ir,  ir], 

(k.6)        STATEMENT.   The  following  are  equivalent: 

(a)  in  a'  (6)      is  integrable  in  [-  w,   w], 

a     — 

(b)  there  exists  a  function  m(z)  in  H   (the  usual  Hardy 
space;  see  RUDIN  [1966,  p.  328])  such  that 

cr;(e)  =  |m(ej0)  f 

(c)  a.e.  on  [-  w,  w], 

(d)   J^l  -  irtn  >0, 

For  a  proof  of  the  above  statement  see  GERONIMUS  [I96I,  pages  20  and  159], 

In  case  the  above  equivalent  conditions  hold  we  may  find  a 
function  m(z)  that  also  has  inverse  that  is  analytic  in  |z|  <  1. 


ko 


Then     m(  z)      is 


TT 


{fe  /  fe  *-;<•)«) ' 


f 

-TT 


and  also 

7   :=    |m(0)|2 

W 

(h.l)  =  exp  j-  |p    f  inc^(e)d9 

-7T 

-     Jt(l  -    lrt|2)    •' 

(See  GERONIMUS  [ 1961,   pages  20,   21,   and  158].)     Furthermore,    if 

a     :=  det  T     ,/det  T  ,    s  =  1,   2,    ...,     and    a     :=  1,     then 
s  s-1'  s'  >      )  >  o  ' 

<Ps(z)*  :=  as*s(z)*,   s  =  0,   1,   ... 

converges  to  m(z)"   as  s  -» ».   This  convergence  is  satisfying  the 
following  inequality  (GERONIMUS  [I96I,  Theorem  k. 10]) : 

(k.8)        |cps(z)Mz)  -i^^jl^.^-^j, 

for   I z I  <  1  and  where 

/  00     0  \l/2 

».5(i  M2 


s  —  I  t=s  '  t 

(Note  that  5  <  +«>  because  of  (k.6).) 
s 

In  case  r(z)  =  tt(z)/x(z)   is  a  rational  C- function  with 

dissipation  polynomial  d(z,  z"  )  ^0,   the  incr*(e)   is  integrable  and 

St 

in  fact 

m(z)  =7l/2T!(z)/x(z), 


1+1 


where  tj(z),  y     satisfy  (4.1)  and  r\(  z)   is  the  stable  spectral  factor 
of  d(z,  z  )  . 

We  now  apply  (U.8)  to  the  C-functions  irt(z)/xt(z)   for 
t  =  1,  2,  . ..,   and  for  s  =  0  : 


R         /7t°s,t         1 \ 


/  00  p   \    1/2 

where     S      .   <  E.    Jr    |  .     Since     y     >  0     and     5         <  -No, 

S,t  —   \U=S+t-l'  U'   /  -L  J-*-1- 

it  follows  that  11m  y.    =   1  and  lim  R     .  =  0.   Consequently, 

l7^/2-n(z)/xt(z)  -  i|  -,0 

as  t  -* oo,  uniformly  on  compact  subsets  of   |z|  <  1.  Hence, 

lim  X(  z)  =  T|(  z)  . 

z— >°° 

Similarly  we  can  show  that  limo7r,(z)  =  t)(  z)  .   □ 

Using  the  above  we  now  want  to  study  the  asymptotic  behavior  of 
the  sequence  of  parameters  of  rational  covariance  sequences.  We  begin 
by  a  motivating 

(4.10)   EXAMPLE.   Consider  the  rational  function 

tt(z)  _  1  +  ( a   +  r)  z 
X(z)  ~  1  +  (a  -  r)z 

of  degree  one.  Necessary  and  sufficient  conditions  for   7r(z)/x(z) 
to  be  in  C  are  that 

|r|<l, 


U2 


and 

|a|  <  1  -    |r|. 
The  sequence  of  parameters   (provided      |r |   *  l)      is  determined  by 


rl  =  T> 

ar 


r„  =  - 


2~       l-    lr|2' 


and  the  nonlinear  recurrence  law 

2 

(^   rs+2  "  ^77— [5  >   for  ■  -  J*  2,  . 

rs(1-  lrs+ll  ) 

Rewriting  the  above  in  the  following  form 


rs+2       rs+l  1 


Vl     rs     '  1  -  ks+1i2 


we  obtain 

(*.«)  rs+2    *2    1"'ri'2 


rs+l"rl"    =g(l-    |rt|2)' 

By  considering  the  factorization  of  the  dissipation  polynomial  of 
f(  z)/x(z)  we  have 

d(z,  z"1)  =  az  +  (1  -  |r|2  +  |a|2)  +  az-1 

=  7Tl(z)Ti(z"  ) 

=  7(Pz  +  (i  +  |p|2)  +  pz"1) 

where  i"|(z)  =  1  +  gz  is  the  stable  spectral  factor  of  d(  z,  z  ). 


hi 


Therefore,  a  =  78  •  Also  by  the  result  of  GERONIMUS  [I961,  Theorem  8.2] 

'  =  Jl^1-  'rt'2)  • 
Combining  the  above  two  facts  with  (4.10)  and  using  (4.13)  we  obtain 

2 

rs+2   r2(1  '  lrl'  )       a 
lim  -SI£  =  -t i =  -  =  p. 

s-*30  r  .,   r.,7  7 

s+1    1 

Equivalently, 


(k.lk)      !im  — ~  =  0. 

rs+1 

This  shows  that  as  s  ->  °°  the  sequence  of  parameters  satisfies  more 

accurately  a  linear  recurrence  law.   Since  in  general  r  ,  s  =  1,  2,  . . 

s 

might  take  also  zero  values,  we  consider  the  equivalent  statement: 

for  all  e  >  0  there  exists  an  s   such  that  for  all  s  >  s 

o  —  o 

'rs+2  "  Prs+l'  ^e  mx  flrs+ll>  |rs+2']- 

This  motivates  the  following : 

(4.15)   DEFINITION.  A  sequence  R  =  {r  :  s  =  1,  2,  ...}  is  said  to 

be  almost  rational  iff  there  exists  a  polynomial  p(z)  =  1  +  p,z  +  ... 

+  8  z   such  that  for  all  e  >  0  there  exists  an  integer  s   with 
Ku    2 —   o  

the  property  that 

k  j,  +P-.r^  ,+...+  Br  I  <  €  J&x     [|r,  |), 
1  s+u    1  s+u-1         us1—  s^t^s+u  '  t'    ' 

for  all  s  >  s  . 
—  o 

A  polynomial  p( z)  with  the  above  properties  is  said  to  be  an  almost 

recurrence  polynomial  for  R. 

(k. 16)   THEOREM.   Let  C  be  a  rational  positive  sequence,   R  be  the 
associated  parameter  sequence  and  r\(  z)  be  the  stable  spectral  factor 


1+1+ 


of  the  associated  dissipation  polynomial.   Then  R  is  almost  rational 
and  T](z)   is  an  almost  recurrence  polynomial  for  R. 

PROOF.  Denote  by  tt,  (z)/x.(  z)   the  rational  C- function  associated 
with  the  usual  truncated  parameter  sequences  R  ,   and  let  these 
functions  have  power  series  expansions 


rt(.) 


=  1  +  2  Lc^^z8,   t  =  1,  2,  

s=l  s    ' 


X^zT 

The  relation  between  (c**  ,  s  =  1,  2,  ...  3  and  R   is  given  by  the 

s 

following  formulas: 


(t) 

'1    "  rt3 


(t) 

c    =  r 

2      t+1 


(i-KiV^1, 


.<*>  :»...*!- 1**-!8)  ♦ 


s+l    t+s  u=ov    '  t+u 

(t)< 

(4t} ...  ^)(ei  ;  I 


M 

i 


Let 


Tl(  Z)  =  1   +   P  Z  +  .  •  •  +  PUZ  , 


u 


and 


4«)  -i +  !■£*>.♦...  +  *4*>-». 


By  the  previous  theorem  ^Lim  Xt(  z)  =  tj(  z)  .   Therefore 

<*•*>   K+u  +  Plrt+u-l  +  •"  +  Vt'  <  lrt+u  +  4t)rt+u-l  +  •••  +but)rt' 


+  e  max   r  , 
t^s^t+u1  s  '» 
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for  all  s  >  s  (e)   and  €  >  0.   The  polynomial  X.(z)   satisfies 

—   O  w 

c<t>+b<t>c(t>+...+b<tU«=o. 
u+1    1   u  u   1 

From  the  above  and  (4.17)  we  now  have 

^9)  IVu  +  bit)rt+u-i+'"+bit)rt^ 


max   -p     f 


where  f,   is  a  polynomial  function  in  v^      ^j   bs  '  ^det  s-l)      ' 
for  s=l,  . ..,  u,  that  when  viewed  as  a  function  of  the  r  ' s  has 
has  zero  constant  term.  We  shall  now  show  that 

(4.20)  lim  f  =  0. 

V      '    t->oo  t 

In  the  case  of  rational  positive  sequences  incr1  (©)   is 
integrable  and  therefore  by  the  result  of  GERONIMUS  [1961,  Theorem  8.2] 
the  parameter  sequence  R  is  squarely  summable.  Hence 

(4.21)  lim  rt  =  0. 

In  view  of  (4.16)  it  follows  that 

o 

lim    c^  =  0. 

t-»°°     s 
s  fixed 

(Note that  lim  c^    '     is  not  necessarily  zero.)      Then 

s^>°°  ,  t:  fixed  s 

(4.22)  lim  det  T^]   =  1 

v  t->°°  S-l 

for  all     s.     Also  by  Theorem  (4.15) 

(4.23)  £m  b<*>  =  ps, 

for  s=l,  ...,  u.  From  (4.21),  (4.22),  and  (4.23)  we  conclude  (4.20) 
Finally  (4.18),  (4.19)  and  (4.20)  imply  that  for  all  £  >  0  there 
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exists  an     s  (e)      so  that 


o 


irt+u +  piWi +  ••• +  Vti  ^  ^m+JT~J> 

for  all  t  >  s  (e).   D 
—  ov 

(U.21)  REMARK.  In  the  applied  literature  on  time- series  analysis  it 
has  been  noted  (see  for  example  BOX  and  JENKINS  [1970,  P.  1791)  that 
the  asymptotic  "behavior  of  the  partial  autocorrelation  coefficients  of 
rational  power  spectra,  that  are  precisely  the  SCHUR  parameters  of  our 
setting,  is  "dominated  by  damped  exponentials".  However,  no  precise 
statement  of  this  seems  to  have  been  proven.  Moreover,  in  case  the 
almost  recurrence  polynomial  has  roots  on   |z|  =  1,  the  above  state- 
ment is  not  absolutely  correct.  For  example  take  r(z)  =  1  -  z. 
Then  the  sequence  of  parameters  is  given  by 

rt     t  +  1 

The  asymptotic  behavior  of  this  sequence  is  not  dominated  by  exponentials. 


CHAPTER  IV.   A  TOPOLOGICAL  APPROACH 

In  this  chapter  we  develop  an  alternative  approach  to  the  study  of 
pr-extensions  of  C  .  We  focus  our  attention  to  pr-extensions  of 
dimension  less  than  or  equal  to  s.   Our  key  result  will  be  an 
implicit  description  of  this  set. 

In  Section  5  we  show  that  for  a  nonempty  open  subset  of  the 

data- set  of  partial  positive  sequences  C   there  exist  no 

s 

pr-extensions  of  dimension  strictly  less  than  s.   This  result  justifies 
our  interest  in  pr-extensions  of  dimension  s. 

After  a  brief  exposition  in  Section  6  of  some  basic  facts  about 
the  topological  degree,  we  derive  in  Section  7  our  key  result:   For 
any  dissipation  polynomial  of  degree  less  than  or  equal  to  s 
there  exists  a  corresponding  pr- extension  of  C   of  dimension 
at  most  s.  We  should  note  that  according  to  the  results  of  the 
previous  chapter  this  dimension  could  be  as  large  as  2s. 

This  result  further  provides  a  novel  proof  of  the  classically 

known  fact  that  the  positivity  of  C   is  a  sufficient  condition  for 

s 

the  existence  of  solutions  to  the  CARATHEODORY  problem. 

Also,  most  important,  this  topological  approach  provides  an 
implicit  description  of  a  nonuniqueness  inherent  in  this  partial 
realization  problem. 

5.   Covariance  Extensions  of  Dimension  s 

The  following  well  known  proposition  gives  conditions  for  a 
rational  function  to  belong  to  C. 

(5.1)  PROPOSITION.  An  irreducible  rational  function  c  tt(z)/x(z), 
with  7r(z),  x(z)  in  C[  z]  and  c  tt(0)/x(0)  =  cq  €  R,  is  in  C  if 
and  only  if 

(a)    d(z,  z"1)  :=-^  {7r(z)x(z'1)  +f(z-1)x(z)} 
is  a  dissipation  polynomial,  and 


^7 


k8 


(b)    -  (tt(z)  +  X(z)}  has  no  root  in   |z|  <  1. 

We  let  C  -  fe.  :  t  =  0,  1,  ...,  s]  be  a  positive  sequence  and 
s     t 
we  consider  a  rational  function  cott(z)/x(z)  with  power  series 

expansion  in  z  that  begins  with 

s      i. 

c  +  2,L  c.  z  . 
o    t^l  t 

A  rational  function  with  this  property  will  be  called  a  partial 

realization  of  C  .   Thus,  a  partial  realization  cQTr(z)/x(z)   of 

C   is  a  pr- extension  of  C   if  and  only  if  (a)  and  (b)  of 

s  s 

Proposition  (5.1)  hold. 

If  c  7r(z)/x(z)  is  a  partial  realization  of  Cs  and  tt(z),  X(z) 
have  degree  less  than  or  equal  to  s,  then  tt(  z)  ,  x(z)   and 
b(z)  :=  (tt(z)  +  X(z)]/2  are  related  via  the  following  nonsingular 
linear  transformations 

(5.2)   co7r(z)  -  [(e0  +  2C;Lz  +  ...  +  2cszS)x(z)]^, 


and 


(5.3)   cQb(z)  =  E(cQ  +  cxz  +  ...  +cszS)x(z)]^, 


where  [   ]S  denotes  truncating  the  powers  of  z  outside  [0,  s] 

We  want  to  consider  when  C   admits  pr-extensions  of  dimension 

s 

strictly  less  than  s.  This  is  given  in  the  following: 


(5.U)   LEMMA.   There  exists  a  pr- extension  of  C   of  dimension 
strictly  less  than  s  if  and  only  if  there  exists  a  polynomial  b(z) 
of  degree  less  than  or  equal  to  s  such  that  for  the  polynomials 
X(z)   and  tt(  z)   obtained  through  (5.2)  and  (5.3)  the  following  hold: 


h9 


(a')   d(z,  z"1)  =  ^  (f(z)x(z-1)  +  wiz^Mz)} 


2 
is  a  dissipation  polynomial, 

(V)   b(z)  =  ^  O(z)  +  X(z))  has  no  root  in   |z|  <  1,  and 

(cr)   tt(z),  X(z)  have  a  nontrivial  common  factor. 

The  essential  point  is  that  (b*)   is  a  closed  condition  as 
compared  with  (b)  in  Proposition  (5.1). 

PROOF.  Suppose  b(z),  tt(z)  and  x(z)   satisfy  the  conditions 
of  the  lemma  and  let  w   (z),  X  (z)  be  coprime  polynomials  such  that 

ir(z)    _  ^o(z) 


Then     deg  ir  (z)      and     deg  X  (z)      are  less  than     s.     Also 

d  (z,    z'1)   =   {f  (z)x  (z"1)   +  w  (z'1)*  (z))/2     is  a  dissipation 
ov    '  ov        o  o  o 

polynomial  and     tt  (z)    +  X  (z)     has  no  zero  in      |z|  <  1.      In  order  for 
w  (z)/x  (z)     to  be  a     pr-extension  of     C       we  only  need  to  show  that 
tt  (z)   +  X  (z)     has  no  root  on      |z|  =  1. 


Suppose     tt  (z  )    +  X  (z  )    =0     for  some     z       with      |z       =  1. 
■^  0000  0  o 


Then 


Mzo>  +  VZo>  I2  =  do<  V  Z^  +  W  I2  +  W*  ■  °' 

Since  d  (z  ,  z"1)  >  0  it  follows  that  jt(  z)   =   X  (z  )  =  0,  which 
o  o   o   —  00     00 

contradicts  the  hypothesis  that  tt  (z)  and  X  (z)  were  coprime. 

Therefore  W   ( z)  +  X  (z)  has  no  root  in   |z|  <  1  and  tto(z)/Xo(z) 

is  a  pr-extension  of  C   with  dimension  strictly  less  than  s. 

s 

The  converse  is  trivial.   □ 

Consider  now  Y  to  be  the  set  of  nonnegative  sequences 
C  =  {c  :  t  =  0,  1,  ...,  s)  that  for  simplicity  we  assume  c  =  1. 


■ 
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The  interior  Y°  of  Y  is  the  set  of  positive  sequences  C 
We  shall  show  that  : 


s 


s 


(5.5)   PROPOSITION.   The  set  of  partial  nonnegative  sequences  C 
that  admit  no  pr-extension  of  dimension  strictly  less  than  s  is 
an  open  subset  of  Y. 

Clearly,  this  would  also  imply  : 


s 


(5.6)        PROPOSITION.      The  set  of  partial  positive  sequences     C£ 

that  admit  no     pr-extension  of  dimension  strictly  less  than     s     is  an 

o 

open  subset  of  Y  . 

PROOF  of  Proposition  (5.5).  Denote  by  X  the  space  of  poly- 
nomials b(z)   of  degree  less  than  or  equal  to  s  with  b(0)  =  1. 
The  subset  of  X  where  (V)   of  Lemma  (5.^)  holds  can  be  shown  to  be 
compact.  Since  Y  is  also  a  compact  space,  it  follows  that  the 
subset  of  pairs 

(b(z),  Cg)  €  X  x  Y 

where  (a')  to  (c')  of  Lemma  (5.1*)  hold  is  also  compact.   The  projection 

onto  Y  being  a  continuous  map,  implies  that  the  subset  of  nonnegative 

sequences  C   (which  by  Lemma  (5.U)  admits  a  pr-extension  of  dimension 

s 
strictly  less  than  s)   is  compact.   The  complement  of  this  set  is 

therefore  open. 

The  fact  that  this  set  is  nonempty  follows  by  considering  the 
partial  sequence  C  =  (1,  0,  ...,  0,  1/2}.  Clearly,  C   is 
positive  and  moreover  there  is  not  even  partial  realization  of  Cg 
of  dimension  less  than  s.  Hence,  there  is  no  pr-extension  of  Cs 
with  dimension  less  than  s  either.   □ 

Given  C  ,  whether  there  exists  a  pr-extension  of  dimension 
s 

strictly  less  than  s  is  a  decidable  question.   It  can  be  answered 
by  applying  the  decision  methods  developed  by  TARSKI  [1951]  and 
SEIDENBERG  [1954]  (see  also  JACOBSON  [197'4,  Chapter  V  ])  to  the 


51 


conditions  of  Lemma  (5-1+).  However,  these  are  very  involved  and  a 
simpler  criterion  is  lacking.   In  fact,  in  the  Appendix  we  shall 
indicate  the  set  of  conditions  that  needs  to  be  tested  for  the  first 
nontrivial  case. 

But,  the  set  of  pr- extensions  of  dimension  less  than  or  equal  to 
s  is  known  to  be  always  nonempty.  We  focus  our  study  on  this  set. 
We  shall  use  concepts  of  homotopy  and  degree  theory  for  this.   So 
we  now  make  a  brief  digression  and  introduce  the  essentials  of 
degree  theory. 

6.  Basic  Degree  Theory 

The  "degree"  of  this  section  refers  to  a  notion  of  topological 
degree  soon  to  be  defined.  The  object  of  study  of  degree  theory  is 
the  solution  set  of  an  equation  d  =  f(b)  where  f  is  a  mapping 
between  two  topological  spaces.  The  main  question  concerns  the 
existence  and  the  number  of  solutions  for  a  given  d. 

Let  S  be  an  open  subset  of  some  topological  space  X,   f  a 
continuous  map  from  S  into  a  topological  space  D,  and  d  be  a 
point  in  D.  The  aim  of  degree  theory  is  to  define  an  integer  valued 
function  deg(f,  S,  d) ,  called  the  degree  of  f  at  d  relative  to 
S,  with  the  properties  that 

(a)  deg  (f,  S,  d)  is  an  estimate  of  the  number  of  solutions 
of  d  =  f(b)   in  S, 

(b)  deg  (.,.,.)  be  continuous  in  the  arguments,  and 

(c)  deg  (.,.,.)  be  additive  in  the  domain  S;   i.e., 
whenever  S^Sg  =  j>     then  deg  (f,  S^S^  d)  = 
=  deg  (f,  Sv    d)  +  deg  (f,  Sg,  d)  . 

As  usual,  when  S  is  a  subset  of  topological  space  X,  we  denote 
by  S,  £S,   and  S°  the  closure,  the  boundary,  and  the  interior  of 
S  respectively.  The  exposition  below  is  following  NAGUMO  [1951], 
SCHWARZ  [1965,  Ch.  Ill],  and  LLOYD  [1978,  Ch.  I]  where  we  refer  for 
additional  information  and  detailed  proofs. 
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N 
Let  X  and  W   both  denote  the  Euclidean  space  R   with  the 

usual  topology.   (The  reason  for  this  redundant  notation  will  become 

clear  below.)   The  set  S  is  assumed  to  be  open  and  bounded 

subset  of  X.   The  maps  that  we  consider  are  continuously 

differ entiable  in  an  open  subset  containing  S.   The  set  of  such 

mappings  is  denoted  by  C  (S)   and  topologized  by  the  norm 


|f  ||  :=  sup   |f  (b)  |  +   sup 
1I&         1<S^ 


ft* 


Given  f  G  C  (S) ,  Z„(S)   denotes  the  set  of  points  d  in  W  such 
that  there  exists  a  point  b  in  f"  (d)  where  the  Jacobian  Jf(b) 
is  zero. 

Suppose  now  that  f  €  CT(§)   and  d  £  W  but  d  £   f(ds)  U  Zf(S). 

The  degree  of  f  at  d  relative  to  S  is  defined  by 

deg  (f,  S,  d)  :=     Z  sign  J„(b) . 

{b£f-1(d)nS}       t 

The  definition  is  extended  to  points  d   that  belong  to  Zf(§),   but 
do  not  belong  to  f(ds),  by  letting 

deg  (f,  S,  dQ)  =  deg  (f,  S,  d) 

for  any  d  £   f(5S)Uzf(S)  and  d  "sufficiently  close"  to  dQ. 

The  fact  that  this  is  well-defined  and  the  precise  meaning  of  the 
term  "sufficiently  close"  are  described  by  the  following  : 

(6.1)    THEOREM.   Let  f  be  as  above  and  d  ,  d   belong  to  the  same 
component  of  W  \f(5s).   Suppose  also  that  neither  of  them  belongs 
to  Zf(S).   Then 

deg  (f,  B,  d±)    =  deg  (f,  S,  dg) . 
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A  simple  consequence  of  the  definition  of  degree  is 

(6.2)  PROPOSITION.   Let  d  ft   f(ds).   Then,   deg  (f,  S,  d)  ^  0  implies 
that  d  G  f(S). 

A  notion  that  is  crucial  for  the  development  of  the  next  section 
is  that  of  homotopy:  A  C  -homotopy  between  two  elements  f   and 
f,   in  C  (§)   is  a  function 

H  :  S  x  [0,  1]  -^RN 

such  that  if  Hx  denotes  the  map  b  t-»H(b,  x) ,   then  H  =  f  , 

H-,  =  f,,  H  G  C  (S)  for  all  x  in  [0,  1]  and  also 
1    1'   x     K 

IIh  -  H  II,  -»0  as  x  ->y.   This  last  condition  says  that  H  is  a 
ii  x    y"i 

continuous  function  in  the  parameter  x. 

The  following  is  a  very  powerful  result  that  we  shall  use  in  the 
next  section. 

(6.3)  THEOREM.   Let  f  ,  f   be  in  C  (s),   and  H  be  a  C  -homotopy 
between  f   and  f  .   If  d  £   H(dS,  x)   for  all  x  in  [0,  1],  then 


de 


g  (fQ,  S,  d)  =  deg  {t±,    S,    d) 


7.  Dissipation  Polynomials  and  Covariance  Extensions  of  Dimension  s 

In  this  section  we  prove  the  following  key  result. 

(7.1)   THEOREM.   Let  C  =  (c  :  t  =  0,  1,  . . . ,  s }  be  a  partial 
positive  sequence  and 

d(z,  z"  )  :=  d  zS  +  ...  +  d.  z  +  1  +  cL  z"  +  ...  +  d  z'£ 

v  '    '     s  1        1  s 

be  a  dissipation  polynomial  (of  degree  <  s) .   Then  there  exists  a  pair 
of  polynomials  (tt(z),  X(z))  with  deg  tt(z),  deg  X(z)   less  than  or 
equal  to  s,  and  a  positive  scalar  k  such  that  the  following  two 
conditions  hold: 
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(a)  c  ii (z)/x(z)      is  a  pr-extension  of  C  ■ 

(b)  kd(z,  z"1)  =  |{tt(z)x(z"1)  +  f(z_1)x(z)}. 

We  now  elaborate  on  the  implications  of  the  above  theorem  with 
two  immediate  corollaries. 

(7.2)  COROLLARY.   Consider  a  partial  positive  sequence  C  .   There 

*  i  ■  ■  ■  ■   ■  ■■■■ -~—     ■   ■  s        ' 

exists  always  a  pr-extension  of  C   with  dimension  at  most  equal  to  s. 

In  this  way  we  have  circumvented  the  need  for  the  algebraic 
machinery  of  orthogonal  polynomials  or  of  interpolation  theory  in 
order  to  establish  that  the  positivity  of  C   is  a  sufficient 
condition  for  the  existence  of  solutions  to  the  CARATHEODORY 
problem.   This  is  essentially  a  problem  in  analysis  and  an  approach 
like  ours  seems  to  be  absent.  Furthermore,  with  this  new  approach 
we  obtain  some  additional  information  about  the  set  of  pr-extensions 
of  dimension  s. 

(7.3)  COROLLARY.   Consider  the  partial  positive  sequence 

C  =  [c  :  t  =  0,  1,  . . .,  s]  where  not  all  of  c  ,  t  =  1,  ...,  s 
are  zero.   Then,  for  almost  any  dissipation  polynomial  d( z,  z  ) 
of  degree  less  than  or  equal  to  s  there  exists  an  associated 
pr-extension  of  C   with  precisely  dimension  s. 

We  now  proceed  to  the 

PROOF  of  Theorem  (7.1).  We  again  denote  by  X  the  space  of 
polynomials  with  constant  term  1  and  with  degree  less  than  or  equal 
to  s. 

Any  b(z)  G  X  defines  through  (5-2)  and  (5. 3)  a  unique  pair 

p 

of  polynomials  (f(z),  X(z))  €  X   such  that  c  ?r(z)/x(z)   is  a  partial 

realization  of  C  ,   i.e.,  has  power  series  expansion  that  begins  with 
s 

c   +  2c,  z  +  ...  +  2c  z  . 

o     1  s 
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The  correspondence  b(z)  -»(f(z),  X(z))   is  certainly 
bijective,  whereas  the  correspondence  b(z)  -*tt(z)/x(z)   is 
clearly  not. 

To  any  pair  (tt(z),  X(z))   as  above  we  associate  the 
polynomial  in  z  and  z  : 

d(z,  z"1)  :=  d  zS  +  .. .  +  d,  z"  +  d  +  cL  z"  +  ...  +  d_z~k 
v  '    '     s  1       o    1 


s 


^{ttC^xCz"1)  +  ^(z_1)x(z)}. 


The  constant  terra  d   equals 

do  =  |[[x(z)r(z)]^x(z"1)]°  +|[[x(z-1)r(z~Vsx(z)]° 

.  [xCz-^Cc^z"3  +  ...  +  csz3)x(z)]° 
=  llx(z)||2, 

where        denotes  the  norm  that  C   induces  on  the  space  of 

s  s 

polynomial  of  degree  less  than  or  equal  to  s  (see  page  15). 
Since  x(0)  =1  and  C  >  0  ,  then 


d0=  h(z)fs  +   0. 

Let     W     be  the  space  of   "symmetric"  polynomials 

Is  -     -1  -     -s 

d(z,    z     )=dz     +...+dnz  +  l  +  dnz       +...+d,z     , 

with  constant  term  equal  to    1.    With     d(z,    z     )      as  above  we  define 
the  map 

cp     :   X  -»W:    (1  +  b  z  +   ...    +  b   zS)  »-^ 

U  -L  S 


/  d  d_  cL        ,  d  \ 

/    s     s  1  1     -1  s     -s  ) 

[-  Z     +   ••'    +~  Z  +  1+~  Z       +   •'•    +  d"Z      / 
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Both  X  and  W  are  Euclidean  spaces  of  the  same  dimension,  and 
cpc   is  continuously  differentiate  in  X. 

We  now  consider  two  open  subsets  S  C  X  and  P  C  W,   where 
S  is  the  subset  of  polynomials  b(z)   that  satisfy 

b(z  )  =0  implies   |z  |  >  1, 

and  P  is  the  subset  that  consists  of  all  d(z,  z  )  £  W  that 
satisfy 

d(z  .  z"  )  >  0  for  all  z   on   |z  |  =  1. 
~v  o*  o  '  —  o       o 

Therefore  S  is  the  set  of  ("stable")  polynomials  b(z)   such  that 

b(z  )  =0  implies   Iz  I  >  1, 
v  o  o  '  — 

and  P  is  the  set  of  dissipation  polynomials  with  constant  term 
equal  to  the  identity. 

The  statement  of  the  Theorem  can  be  easily  seen  to  be  equivalent 
to  the  following:   for  any  d  £   P  there  exists  a  b  £   S  such  that 

d  -  cpc  (b). 
s 

Therefore  we  need  to  show  that  cpp  (S)  D  P. 

^s 

Since  the  roots  of  a  polynomial  depend  continuously  on  the 

coefficients  (see  MARDEN  [1966])  it  follows  that  S  is  open.  Also 

because  the  roots  of  every  b( z)   in  S  lie  in   |z|  >  1,  it  follows 

that  S  is  bounded.  We  shall  first  show  that 

(7.U)   cpc  (S)  D  P. 
s 


For  the  particular  sequence  C  =  {1,  0,  ...,  0}  the  map 
cp  takes  the  simple  form 
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cpco   :    b(z)    =  1  +  bxz  +   ...    +  bgzS  ^  b(z)b(z"1)/t|o    |bt|2. 

It  is  straightforward  to  show  that 

(7.5)  deg  (cpco,  S,  d)  =  1  for  any  d  in  P. 

s 

In  fact  the  computations  can  easily  be  done  for  d(  z,  z  )  =  1, 
and  since  Cp  0(dS)  =  oT  we  use  Theorem  (6.1)  to  establish  (7»5)« 

The  set  of  positive  partial  sequences  is  connected  (this  is 
obvious  especially  when  we  consider  the  SCHUR  parametrization; 
see  page  11 ) .   Therefore  we  can  follow  a  path  within  the  set  of 
positive  sequences  from  C   to  any  other  positive  sequence 
C  .   In  this  way  we  construct  a  continuous  homotopy  H(b,  x)  between 
cpco  and  cpc  . 

We  now  show  that 

(7.6)  <p.  (dS)  Hp  ■  .^  for  any  C  >  0. 

s 

Suppose  b(z)  €  SS.   Then  b(z  )  =0  for  some  z   with   |z  1=1. 

v         -1  °   ?      ° 

Therefore,  if  d(z,  z~  )  =  cpc  b(z)G  P,   then   |b(z  )  |'"  =  0  implies 

s  o 

d(z  ,    z"1)    =  0. 

K     O  O 

Consequently,      d(z,    z~   )   G  oT     and  (7.6)    is  proven. 

If     H(b,   x)     is  a  homotopy  as  above,   then 

H(dS,    x)  H  p  £  fa 
for  all     x     in     [0,1].      By  Theorem  (6.3)   we  conclude  that 

<ieg  (cpCs,    S,    d)    =  1, 

for  any  C  >  0  and  any  d  in  P.  Hence,  by  Proposition  (6.2)  it 

s 

follows  that 
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Vc   (S)  D  P 
s 


for  all  C  >  0.   By  the  compactness  of  S  we  also  have  that 
s 


cpc  (S)  DP.   D 
s 


We  want  to  close  this  chapter  with  the  following  : 

(7.7)   CONJECTURE.   The  correspondence  between  dissipation 
polynomials  d(z,  z~  )   and  pairs  of  polynomials  (tt(z),  X(  2 
with  7r(0)  =  X(0)  =  1,   in  Theorem  (7.1)  is  bijective. 


The  conjecture  is  certainly  true  for  the  trivial  sequence 
C  =  [1,  0,  ...,  0).  We  were  also  able  by  direct  computation  of  the 
Jacobian  to  show  that  it  holds  in  a  neighborhood  of  d(z,  z  )  =  1. 
But  a  proof  is  still  lacking.  We  should  mention  that  the  map 
cpQ   is  not  analytic;  therefore 

deg  (cpCs,  S,  d)  =  1 

for  all  d  in  P  does  not  imply  that  the  cardinality  of  <Pr  (d)  ■"  s 

— — -^  g 

is  one. 


CHAPTER  V.   THE  MATRIX  CASE 

8.   The  Matrix  Covariance  Extension  Problem 

Given  an  n-variate,  zero-mean,  stationary  stochastic  process 
y  ,  t  €  Z  we  denote  by 

cs  :=  EvW  s  =  °' x*  •••' 

the  covariance  n  x  n-matrix- function  of  y  .  In  this  chapter  we  shall 

T 

use  "~"  to  denote  the  "complex  conjugate  transpose  of". 

The  covariance  sequence  C  -   (c  :  s  =  0,  1,  . . . }  is  characterized 

s 

by  the  nonnegative  definiteness  of  the  block  Toeplitz  matrices 

T  =  [c,   ]?    ,  s  =  0,  1,  ..., 
s     t-u  t,u=o7 

where  now  c  u ,  :=  cV  i.   (See  for  example  GIHMANW  and  SK0R0H0D 
-|t|     |t| 

[197U,  p.  196].) 

Thus,  we  define  a  matrix- sequence 

C  =  fc  :  s  =  0,  1,  ....  with  c   Hermitian] 
s       >      >  *  0 

to  be  positive  (resp.  nonnegative)  iff  the  associated  block  Toeplitz 
matrices  T   are  positive  (resp.  nonnegative)  definite  for  all  s. 

a 

We  similarly  define  the  partial  matrix  sequence 

C  =  {c.  :  t  =  0,  1,  ...,  s)  to  be  positive  (resp.  nonnegative)  iff 

T   is  a  positive  (resp.  nonnegative)  definite  matrix, 
s 

This  notion  of  matricial  positivity  is  again  related  to  an 

analytic  property  of  the  matrix-valued  power  series 


r(z)  :=  c  +  2  Lc 


s 
z  , 
s 


(8.1)   THEOREM  (see  KOVALISHENA  and  POTAPOV  [1982]).   The  power  series 
r(z)   converges  in   |z|  <  1,  and 

T(  z)  +  T(z) 
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is  a  nonnegative  definite  matrix  for  all  z  in  |z|  <  1  if  and  only 
if  the  sequence 

C  =  {c  :  s  =  0,  1,  ....  with  c  =  (c  +  c)/2} 
s  o 

is  nonnegative. 

Matrix-valued  functions  that  satisfy  the  above  conditions  will 
again  be  said  to  belong  to  class  C. 

The  following  is  now  the  matrix  CARATHEODORY  problem:   Given  a 

partial  sequence  C  ,   find  necessary  and  sufficient  conditions  for 

s 

the  existence  of  a  matrix-valued  C-function  with  power  series  that 
begin  with 

c  +  2.L..C,  z  . 
o    t=l  t 

The  matrix  CARATHEODORY  problem  seems  to  have  been  considered  only 
recently  by  IL'MUSKIN  [1971*-],  and  KOVALISHINA  [197^] .   See  also  AROV 
and  KREIN  [I98I],  DELSARTE,  GENIN  and  KAMP  [1979]  and  KOVALISHIWA  and 
POTAPOV  [1982].  As  an  interpolation  problem  it  can  also  be  approached 
through  the  functional  analytic  techniques  of  SZ.-NAGY  and  FOIAS 
[1970].   See  e.g.,  HELTON  [I98O]. 

In  the  next  two  sections  we  will  consider  the  subclass  of  rational 
solutions  and  carry  out  some  of  the  program  followed  in  the  scalar  case. 

The  matrix  sequence  C  is  said  to  be  rational  iff  there  exists  an 
integer  v  such  that  for  all  s  >  v  the  block-behavior  (Hankel) 
matrices 

Bs  =  Lct+u-lJt,u=l 

have  the  same  rank.   This  integer  v  will  again  be  called  the  dimension 
of  C. 

The  rationality  of  C  is  equivalent  to  r(z)  defining  a  rational 
function  in  z.  In  this  case  r( z)   can  be  represented  as  a  matrix 
fraction  P(z)Q(z)_1  (right)  or  Q(z)"1p(z)   (left). 
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Suppose  that  C  is  rational  and  that  P(z)Q(z)~   is  a  right 
matrix  fractional  representation  of  r(z)  where  P( z)  and  Q(z) 
are  right  coprime  polynomial  matrices,   i.e.  there  exist  A(z), 
B(z)  e  C^z]  such  that  A(z)p(z)  +  b(z)q(z)  -  I.  Then  it  can 
be  shown  that  the  dimension  of  C  is  equal  to  the  maximum  of  the 
degrees  of  P(z)  and  Q(z).   (in  this  chapter,   "I"  will  denote 
the  n  x  n  identity  matrix.) 

In  Section  9  we  present  a  generalization  of  our  topological 
approach  for  the  matrix  CARATHEODORY  problem.  We  shall  draw  similar 
conclusions  as  in  the  scalar  case:  (a)  the  positivity  of  the  partial 
sequence  C   is  sufficient  for  the  existence  of  solutions,  and  (b)  for 
almost  any  matrix-dissipation  polynomial  of  degree  less  than  or  equal  to  s 
there  exists  a  corresponding  rational  solution  of  dimension  less  than  or  equal 
to  s. 

In  Section  10  we  shall  give  a  brief  account  of  the  basic  results 
that  come  out  of  the  algebraic  approach  and  SCHUR's  algorithm  when 
applied  to  this  matrix- interpolation  problem. 


9.   The  Topological  Approach 

We  begin  by  establishing  the  matrix  version  of  Proposition  (5.1). 

(9.1)   PROPOSITION.  A  rational  function  P(z)q(z)_1  with  q(z), 
P(z)   in  C   [z]  and  P(0)q(0)~   Hermitian  positive  definite, 
is  in  C  if  and  only  if 

det  [ Q( z  )  +  P( z  ) ]  =  0  implies   | z  |  >  1, 
and 

D(z,  z_1)  :=|  {Q(z_1)p(z)  +  P(z_1)Q(z)} 

has  nonnegative  definite  values  for  all  z  such  that   |z|  =  1. 

As  in  the  scalar  case,  we  call  D(z,  z  )   the  dissipation  (matrix-) 
polynomial  of  P(z)q(z)"  .   By  a  slight  abuse  of  our  terminology,  we 
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shall  also  call  any  matrix  polynomial  in  z  and  z    satisfying 
the  above  property  a  dissipation  polynomial. 

PROOF.  An  n  x  n  matrix- function  S(z)   is  said  to  be  in 
class  S  iff  it  is  analytic  in   |z|  <  1,  and 

I  -  S(z)S^z)  >  0 

for  all  z  in   |z|  <  1.   These  functions  are  considered  in  operator 
theory  (see  SZ.-NAGY  and  FOIAS  [1970])  where  they  are  called 
"contractive"  and  in  circuit  theory  (see  BELEVITCH  [1968])  where 
they  are  called  "bounded".   The  relation  between  C- functions 
r(z),  with  r(0)  Hermitian  positive  definite,  and  S- functions 
S(z)   is  given  by  (see  for  example  [DELSARTE,  GENIN,  and  KAMP 
[1979,  P.  391) 

(9.2)  s(z)  =  |(r(o)  -  r(z))(r(o)  +  r^T)'1, 

and 

(9.3)  r(z)  =  (i  -  zs(z))(i  +  zs(z))_1r(o). 

So  we  let  r(z)  =  P(z)q(z)~  .  Without  loss  of  generality  we 
can  assume  that  r(0)  =  I.  Then  we  obtain 

S(z)  =  |  (Q(z)  -  P(z))(Q(z)  +  P(z))"1, 

and  also  that,  S(z)  is  in  S  if  and  only  if 

det  ( Q,(  z  )  +  P(  z  ) )  =0  implies   |  z  |  >  1 , 

and 

I  -  S(z)sTz)  >  0, 

for  all  z  in   | z |  <  1.   By  the  maximum  modulus  principle  it  is 
sufficient  to  test  this  on  the  boundary  of  the  region  of  analyticity: 
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I  -  S(z)S(z_1)  =  2(Q(z"1)  +  P(Z"1))"1D(z,  z-1)(Q(z)+P(z))'1>0 
for  all  z  on  |z|  =  1.  Clearly  this  holds  if  and  only  if 

D(z,  z"1)  >  0.   D 

($.k)        THEOREM.   Let  C  =  {c  :  t  =  0,  1,  . . . ,  s )  be  any  partial 
positive  n  x  n-matrix  sequence  and 

(9.5)   D(z,  z"1)  :=  d  zs  +  ...  +  d^z  +  I  +  d^z"  +  ...  +  dgz"S, 

be  an  n  x  n-matrix  dissipation  polynomial.   Then  there  exists  a 
pair  (P(z),  Q(z))  e  (^[z])2  with  deg  P(z),  deg  q(  z)  less 
than  or  equal  to  s,  and  a  positive  definite  matrix  K  such  that 
the  following  two  conditions  hold: 

(a)  P(z)q(z)~   is  a  pr- extension  of  C  , 

(b)  ^%(zt    z"1)^2  =  \   {QCz-V(z)  +  Hz'1)^)}. 

(With  (  )  '   we  denote  the  "Hermitian  square  root  of".) 

This  theorem  establishes  that  when  the  partial  sequence  C   is 

s 

positive,  the  matrix  CARATHEODORY  problem  is  solvable.   Our  technique 
does  not  seem  to  be  possible  to  extend  to  the  singular  case  when 

C   is  only  nonnegative.  However,  it  provides  information  about  the 

s 

solutions  of  dimension  s,  precisely  as  it  did  in  the  scalar  case: 
For  a  generic  set  of  dissipation  polynomials  of  degree  less  than  or 
equal  to  s,  we  can  associate  pr-extensions  of  C   of  precisely 
dimension  s.  For  the  complement  of  this  set  we  can  associate 
pr-extensions  of  dimension  less  than  s. 

The  idea  of  our  proof  is  similar  to  the  one  we  gave  for  the  scalar 
case.  However,  certain  new  features  require  the  use  of  a  more 
sophisticated  technique.  The  main  new  aspect  is  that,  in  contrast  to 
the  scalar  case,  matrix  polynomials  with  no  determinental  zeros  in 
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| z |  <  1  and  with  constant  term  the  identity  matrix,  do  not  form 
a  bounded  subset  of  the  space  of  the  coefficients.  For  example, 
the  polynomial 

1   0\  .   /l/2    a 
1  +  z  ' 


0   1/     \  0    1/2 

has  nonvanishing  determinant  for  all  |z|  <  1  and  all  values  of 
a  as  well.  We  circumvent  this  by  considering  our  stability  set 
on  a  certain  compact  manifold. 

PROOF.   Let  P(z)Q(z)"1,  with  P(z)q(z)   in  C^^z],   be  a 
partial  realization  of  C   of  dimension  less  than  or  equal  to  s. 
Then  P(z)  and  Q(z)  are  related  by 

(9.6)  P(z)  =  [(co  +  2cxz  +  ...  +  2cszS)Q(z)]^. 

Clearly,  q(0)   is  nonsingular.  We  now  define  the  polynomial  B(z)  by 

(9.7)  B(z)  =  [(cQ  +  cxz  +  ...  +  cszS)Q(z)]^, 
and  the  polynomial 

(9.8)  D(z,  z_1)  =  DszS  +  ...  +  filz  +  ^  +  j^z"1  +  ...  +  Dsz"S 

:=i{Q(z_1)P(z)  +  P(z_1)Q(z)} 

in  z  and  z"  .  By  Proposition  (9-1),   P(z)q(z)"   is  in  C  if  and 
only  if  det  B(z)  has  no  roots  in   |z|  <  1  and  g(z,  z  )   is 
nonnegative  definite  for  all  z  on   |z|  =  1.  We  notice  that  the 
pair  (Q(z),  P(z))   is  defined  up  to  a  right  unimodular  factor. 
Therefore,  so  is  B(z).  Moreover,   det  B(0)  f   0. 

Thus,  we  consider  the  space  X  of  polynomials 
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(B(z)  =  Bq  +  B  z  +  ...  +  BszS,  B(z)  £  c"3"^  z]  } 

of  degree  less  than  or  equal  to  s.  In  this  space  we  consider  the 
subset  M  defined  by 

,E  B.  B.  =  I, 
t=o  t  t    ' 

(9.10) 

B  >  0,   and  B   upper  triangular. 

2 
This  subset  is  a  smooth  compact  manifold  of  real  dimension  2sn  .   That 

M  is  a  smooth  manifold  follows  from  the  open  condition  det  B  *  0. 

Compactness  follows  from  the  fact  that, by  the  first  condition, any  entry 

of  B,,  t  =  0,  ...,  s  has  modulus  less  than  or  equal  to  1.  (it  is 

also  easy  to  show  that  M  is  orientable,  but  we  will  not  need  this 

fact  here.) 


tions  P(z)Q,(z)~   of  C   with  dimension  less  than  or  equal  to  s 

s 


The  correspondence  between  B(z)   in  M  and  partial  realiza- 
(z)Q(z)'1  of  C 
is  clearly  surjective.   If 

Q(z)  =  Qo  +  Qxz  +  ...  +  QgZS, 


then  the  polynomial     D(z,    z~  )     obtained  by  (9'8)    satisfies 


Cl 


c 


v<s>    Qi  •••  QsM         ° 


c  -.  •    •    • 

s-1 

Since  det  Q  *  0  and  C  >  0,   it  follows  that  D  >  0.   Therefore 
o  s  ~o 

the  following  map  is  well-defined: 

cp  :   M    -+  W 
s 


b(»)  ^B"01/2B(^  ^Kl/2' 
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where  W  is  the  space  of  the  polynomials  D(z,  z  )  as  in  (9«5)  ; 
i.e.,  such  that  D(z,  z  )  =  D(  z  ,  z)   and  with  constant  term  equal 
to  the  identity  matrix. 

Consider  the  submanifold  S  of  M  of  polynomials  with 

determinant  nonvanishing  in   |z|  <  1,  and  the  submanifold  P  of  W 

of  polynomials  D(z,  z"  )   that  have  nonnegative  definite  values  for 

all  z  on   |  z  |  =  1.  To  complete  the  proof  of  the  theorem  we  need  to 

show  that  for  all  C  >  0  we  have 

s 

PCcp  (§). 
Ls 

Precisely  as  in  the  scalar  case  it  can  be  shown  that 

cpP(ss)  n  p  =  0. 

^s 

Also, the  set  of  positive  partial  matrix  sequences  C   is  pathwise 

connected.  By  using  the  homotopy  invariance  property  of  the  degree  > 

the  proof  that  was  given  for  the  scalar  case  works  in  this  case  also. 

More  precisely  cp   is  certainly  a  continuous  map  between  manifolds. 

^s 
(cp0  is  only  continuous  because  we  require  taking  the  Hermitian  square 

s  1 

root.)  Now  MILNOR  [1965]  defines  the  degree  for  C  -mappings  between 

manifolds.  However,  as  remarked  by  LLOYD  [1978,  p.  32]  the  definition 

immediately  extends  to  the  continuous  case  simply  by  taking  C^ 

approximations.  (An  explicit  argument  can  be  found  in  SCHWARTZ  [1965, 

Chapter  V]  and  LLOYD  [1978,  Chapter  I].)   Finally,  we  note  that  as 

before  the  degree  deg  (cpc  ,  S,  D)   can  be  seen  to  be  1  by  considering 

the  point 

D(z,  z'1)  =  I 
and  the  trivial  sequence 

C  =  (I,  0,  ...,  0}. 

0 

The  proof  now  proceeds  precisely  as  in  the  scalar  case.   D 
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10.   The  Algebraic  Approach 

The  description  of  all  solutions  to  the  matrix  CARATHEODORY 
problem  can  be  found  in  AROV  and  KREIN  [ I98I]  and  KOVALISHINA  and 
POTAPOV  [I982].  It  is  given  in  the  so-called  "completely  nondegen- 
erate  case",  when  C   is  a  positive  sequence.   In  the  general  case, 

when  C   is  nonnegative  but  not  positive, there  exists  no  closed 

s 

form  expression  for  the  solutions.  However,  some  standard  techniques 
in  operator  theory  can  be  used  to  deal  with  this  case  (cf. 
SZ.-NAGY  and  FOIAS  [1970,  p.  188]) . 

In  this  section,  having  presented  our  topological  approach,  we 
wish  to  give  a  brief  account  of  the  basic  results  and  ideas  of  the 
algebraic  approach,  which  essentially  relies  again  on  SCHUR's 
algorithm.  We  shall  apply  this  to  the  case  of  rational  C- functions. 

We  begin  by  describing  the  SCHUR's  algorithm  for  the  case  of 
matrix  C- functions.  The  main  technical  fact  is  given  in  the 
following: 

(10.1)  LEMMA.   Let  r,  ( z)  be  a  matrix-valued  function  which  has  a 

power  series  expansion  around  the  origin  that  begins  with  I  +  2r  z, 

where  I  -  rr  >  0.   Then  I\(z)   is  in  C  if  and  only  if  there 
t  t      tx    ~  

exists  a  C- function  P.  -(z)   such  that 

(10.2)  rt(z)  =  [at(z)rt+1(z)  +  bt(z)][ct(z)rt+1(z)  +  d^z)]"1, 

where 


a 


.(z)  =  (I  -  rtr  )"4/-s(l  -  rt)  +  z(i  -  r^)  ^'(i  -  rt), 


bt(z)  =  (I  -  rt?t)~l/2(l  +  rt)  -  z(l  -  ?trt)'l/2(l  +  ?t), 
ct(z)  =  (I  -  rtrt)^2(l  -  rt)  -  z(i  -  Vt)"l/2(l  -  rt), 
dt(z)  =  (I  -  rt?t)"l/2(l  +  rt)  +  z(l  -  ?trt)_l/2(l  +  ?t) . 
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PROOF.  The  SCHUR's  recurrence  relation  for  the  matrix  case 
is  given  by  (see  for  example  DELSARTE,  GENIN,  and  KAMP  [1979,  (36)]) 

St(z)  «  (I  -  ?trtrl/2  (rt  +  ^+1(Z))d  ♦  "tS^^Cl  -  r^"172. 

Assuming  that  I  -  r.r  >  0,   then  S  ( z)   is  in  S  if  and  only  if 
S   (z)   is  in  S.  Applying  the  bilinear  transformation  (9-2)  we 
obtain  the  corresponding  recurrence  relations  for  the  class 

C- functions.   □ 

Formula  (10.2)  can  be  solved  for  r.  ,  (z)   in  terms  of  T,(z)  and 
provides  an  inductive  procedure  for  solving  the  CARA1HE0D0RY 
problem  in  the  completely  nondegenerate  case. 

In  the  completely  nondegenerate  case  a  matrix- vers ion  of  (2.9) 
can  also  be  obtained  (see  for  example  AROV  and  KREIN  [I98I]). 

Here  we  shall  apply  the  lemma  to  rational  C-functions 
P+(z)Q,(z)"?  and  consider  the  behavior  of  the  dimension  and  the 
dissipation  polynomial  under  the  action  of  "truncating"  the  sequence 
of  SCHUR  parameters  r,   or,  equivalently,  as  t  increases.  We 
now  have  the  following: 

(10.3)   THEOREM.   Let  r,(z)  and  r\+,(z)  be  in  C  and  related 
as  in  Lemma  (10. 1).   Then  T,(z)   is  rational  if  and  only  if  r,  ,(z) 
is  rational.   In  this  case,  there  exist  right  coprime  representations 
Tt(z)  =  Pt(z)Qt(z)"1  and  Tt+1(z)  =  P^z)^^)"1  with  Pt(z), 
Q^z),  Pt+1(z),  ^.+1(z)   in  C^tz]   such  that 


Pt(«)\      i      /at(z)        bt(z)WPt+1(z> 
\{z)J  \ct(z)        dt(z)  /\Qt+1(z)y 


(10.4) 


Also,  if  D,(z,  z  ) (resp.  D.  , (z,  z  ))   denotes  the  associated 
dissipation  polynomial 
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(10.5)  Dt(z,  z"1)  =  Dt+1(z,  z"1). 

Moreover,  the  following  are  equivalent: 
(a)    dim  rt(z)  =  dim  rt+1(z), 

(a')   dim  r.(z)  =  deg  I>t(z,  z"  ), 
(a")   dim  rt(  z)  =  deg  (Pt(z)  +  Q^z)). 

For  the  proof  we  need  the  following: 

(10.6)  LEMMA.   The  following  identity  holds: 

/^(z"1)    bt(z"1)\/a(z)    b(z)\ 

Vc^z"1)    at(z-1)/\c(z)    d(z)/ 

PROOF.   By  direct  computation.   D 

We  now  proceed  to  the 

PROOF  of  Theorem  (10.3).  Suppose  r.+,(z)   is  a  rational 
C- function  and  is  equal  to  pt+1( z) Q++i( z) "  *     where  P++1( z) > 
Q^  (z)  are  right  coprime  matrix  polynomials.  Define  P+(z)>  Q+( z) 
via  (10.4).  It  can  be  checked  that  ct(z)Pt+1(z)  +  dt(  z)  Q^C  z) 
is  invertible  as  a  power  series  in  z.  By  Lemma  (10.1)  it  follows 
that  r.(z)  =  Pt(z)Q.(z)"  .  Furthermore,  it  holds  that  Pt(z)> 
Q,(z)   are  right  coprime. 

Indeed,  since  Pt+1(z)>  %+±^z^     are  vlS^t   coprime,  there  exist 
polynomial  matrices  A(z)   and  B(z)   such  that 

A(z)Pi  ,(z)  +  B(z)^  (z)  =  I.  Hence,  from  Lemma  (10.6)  and  (10.4), 
we  obtain  that  there  exist  polynomial  matrices  A,(z)   and  E,(z) 
such  that 
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A1(z)?t(z)  +  B^z^z)  =  z2ni. 

But  both  det  P.(0)   and  det  0^.(0)   can  be  checked  to  be 
different  from  zero.   Therefore,  P+(z)  and  Q.(z)   are  in  fact 
right  coprime. 

The  converse  follows  similarly  by  considering  the  identity 
(10.7)  z 


^+1(z)/    \ct(z)     at(z)/  \^(z) 


that  follows  from  Lemma  (10.6). 

Relation  (10. 5)  follows  by  considering 

-1    1  ~   -1  ~   -1   /Pt(z)\ 

and  applying  Lemma  (10.6). 

Finally,  the  equivalence  of  (a),  (a'),  and  (a")  can  be  shown 
as  in  the  scalar  case  (see  Proposition  (3.5)) •   □ 

Thus,  the  precise  analogues  of  certain  facts  that  were  seen 
to  hold  in  the  scalar  case,  apply  to  the  matrix  case  as  well.  We 
expect  that  the  results  of  Section  5  extend  to  the  matrix  case 
also,  and  that  the  matrix  dissipation  polynomial  determines  the 
asymptotic  behavior  of  the  matricial  SCHUR  parameters. 


CHAPTER  VI.   APPLIED  ASPECTS  OF  THE  COVARIANCE  EXTENSION  PROBLEM 

In  this  final  chapter  we  want  to  discuss  the  relevance  of  the 

covariance  extension  problem  to  the  applied  area  of  time-series 

modeling.   This  area  involves  a  large  number  of  issues  that  we  shall 

not  touch  upon  (e.g.,  issues  of  statistical  nature,  see  BOX  and 

JENKINS  [1970],  or,  of  the  essential  difference  between  prediction  for 

time- series  and  prediction  for  stochastic  processes,  see 

FURSTENBERG  [i960]).   Instead  we  shall  consider  as  our  point  of 

departure,  the  knowledge  of  a  partial  (sampled)  covariance  sequence 

C  . 
s 

Based  on  these  data,  certain  schemes  have  been  proposed  that 

yield  a  unique  rational  covariance  extension  for  C  .   These  schemes 

s 

form  the  base  of  modern  nonlinear  methods  for  spectral  estimation 
(cf.,  HAYKIN  [1979,  pages  %   and  103]).  We  begin  Section  11  by 
considering  the  so-called  "maximum  entropy"  (ME)  method  in  the  context 
of  our  previous  development. 

The  ME  method  proposes  the  use  of  a  particular  pr-extension  of 

C   that  has  constant  dissipation  polynomial.  The  constancy  of  the 

s 

dissipation  polynomial  makes  the  construction  of  a  corresponding 
stochastic  realization  trivial  (since  the  problem  of  spectral  fac- 
torization is  avoided  altogether) .  Moreover,  this  construction 
turns  out  to  be  recursively  updated  as  the  data  set  increases.  This 
latest  property  is  precisely  the  recurrence  relation  satisfied  by 
the  orthogonal  polynomials  and  was  established  in  this  context  by 
LEVINSON  [19U7].  Recursiveness  is  very  important  in  practical  appli- 
cations as  it  provides  an  efficient  approximation  procedure.  In 
point  of  fact,  this  is  the  underlying  philosophy  in  the  ladder 
structure  constructions  in  modern  digital  filter  design. 

However,  the  absence  of  zeros  in  the  power  spectrum  obtained 
by  the  ME  method  gives  rise,  in  certain  cases,  to  undesirable 
phenomena  (see  HERRING  [I98O]  and  the  references  therein).   Motivated 
by  the  need  for  more  general  pole- zero  approximating  techniques,  for 
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the  covariance  function  of  stochastic  processes,  DEWILDE,  VIEIRA, 
and  KAILATH  [1978],  and  DEWILDE  and  DYM  [1981a  and  1981b]  (see 
also  RUCKEBUSH  [1978]  and  ROSENCHER  and  CLERGET  [1979])  have  placed 
the  problem  in  a  more  general  context  of  Nevanlinna-Pick  interpolation 
theory.  However,  these  investigations  do  not  seem  to  illuminate 
the  basic  partial  realization  problem  where  the  data  is  simply 
C  .  Pole- zero  modeling  in  the  context  of  partial  realization  setting 
remains  "a  nonlinear  and  implicit  problem,  and  there  is  no  possibility 
for  recursively  updated  realizations  of  increasing  order"  (see 
BENVENISTE  and  CHAURRE  [I98I]). 

In  Section  12  we  shall  indicate  that  this  might  not  be  precisely 
so.   Certainly,  as  it  appears  from  our  results  of  Chapter  III,  an 

essential  part  in  obtaining  pr-extensions  of  C   with  nontrivial 

s 

dissipation  polynomial, is  in  obtaining  information  about  the 
dissipation  polynomial  or,  equivalently,  the  zeros  of  the 
corresponding  power  spectrum.   (Our  results  of  Chapter  III,  in 
particular  Theorem  (4.15)  suggests  that  the  parameter  sequence  might 
be  used  for  that.   This  is  a  point  that  requires  further  investigation.) 
We  should  note  that  this  information  is  already  assumed  in  the 
approximation  theories  of  DEWILDE  and  DYM  [1981a  and  1981b J.  Now, 
provided  such  information  is  available  we  shall  indicate  a  way  that 
this  can  be  incorporated  in  the  modeling  process  in  an  efficient 
way.   Theorem  (12.4)  will  describe  a  recursive  construction  for 
pr-extensions  that  have  approximately  fixed  zero- structure. 

11.   The  ME-Method  and  Some  General  Discussion 

Let  C   be  a  partial  positive  (scalar)  covariance  sequence  and 

assume  c  =  1.   The  simplest  possible  choice  for  an  admissible  extension 

of  the  partial  parameter  sequence  R  is  certainly  the  trivial  extension 

s 

[r    :  r  ,  =  0  for  t  =  1,  ...).   This  extension  amounts  to  choosing 

S"i"X      S~i~U 

r  ,  (z)  =  1  in  Theorem  (  3.1 ).   The  associated  pr-extension  of  C 

s+1  *  s 

is  simply 
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i  \      *  (z)* 

tt(z)    sv  ' 


X(z)   $  (z)*  * 

This  particular  extension  has  a  certain  uniqueness  property, 
namely,  it  maximizes 

e  :=  lim  ||<P,(z)*|i2, 

00       t— »°°      t 

i.e.,  the  distance  in  the  ||  ||-norm  of  1  from  the  closure  of 
the  manifold  spanned  by  positive  powers  of  z.   It  is  immediate 
from  (1.6)  that  in  this  case 

lkt(z)*ll2=  llos(z)*||2, 

for  all     t  >  s,      and  hence, 

e     =    .lira     |k(z)*||2  =    ||$   (z)*||2. 

oo  t— >°°  t  S 

We  now  would  like  to  explain  the  importance  of  this  quantity  in 
the  prediction  theory  of  stochastic  processes.  The  inner  product  (•, • ) 
that  was  defined  in  Section  1  relative  to  a  nonnegative  sequence  C, 
can  be  extended  from  the  space  of  polynomials  in  z  to  a  more  general 
space  of  functions  on   |z|  =  1.   This  is  done  by  realizing  this  inner 
product  via  a  Stieljes  integral 


<a(z),  b(z)>  =  ^-   /.F  a(z)b(z)da(0) ,  z  =  exp  j0, 

with  a(eje),  He3®)   £   Lp[dcr(9)]   the  Hilbert  space  of  squarely 
integrable  functions  on   |z|  =  1  with  respect  to  the  measure  dcr(0) 
(c(s)      being  the  spectral  distribution  function  of  C,  cf.,  Remark 
(3.8)).  Let  now  y  ,  x  £  Z,  be  a  (zero-mean,  stationary)  stochastic 
process  having  C  as  covariance  sequence.   Let  also  L?(y)   denote 
the  Hilbert  space  generated  by  y   with  the  inner  product  defined  by 


Ik 


(f,  g)  :=  Efg, 

f,  g£  L„(y),   and  E  denoting  the  expectation  operator.   Then, 
the  mapping 

yT^eJ 

extends  to  an  isometry  between  l^[da(0)]  and  Lg(y)   (cf.,  GRENANDER 

and  SZEGO  [1958,  p.  175]).  Via  this  mapping, any  linear  problem  in 

L  (y)   can  be  translated  into  one  in  L  [dcr(e)]  and  conversely.   Let 

now  g  (z)   be  any  polynomial  in  z  with  g  (0)  =  1  and  degree  less 
s  s 

than  or  equal  to  s.   Clearly,  due  to  the  orthogonality  properties 
(1.3), 

K<*)*ii2  =  g%  ik^ii2. 

S 

Therefore, 

e  =  .lim  |k(z)*||2  =  J-im  inf  E  ly  -  E  a  y   |2 
co   t->  °°    tv  '  "    t-»°°  au     '  o   u=i  u  -u1 

l<u<t 

is  the  square  of  the  variance  of  the  prediction  error  of  y   at 
an  instant  t  =  0  based  on  observations  in  the  past  t  <  0.  And 
this  is  maximized  by  the  choice  r  ,(z)  =  1  over  all  pr-extensions 
of  the  partial  data  C  . 


The  quantity  e   is  an  essential  characteristic  of  a  stochastic 
process  and  describes  the  "predictability"  of  the  process.   One  can 
show  that  (see  GERONIMUS  [1961,  p.  1581 ) 

e  =  TL  (1  -  |r.|) 
°°   t=l  v     '  t ' 

=  exp  {-^-  JW  In  o-,(0)de}. 
r  12tt  -it         av 
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The  stochastic  process  is  called  deterministic  iff  e^  =  0,  and 
nondeterministic  otherwise.  This  quantity  is  directly  related  to  a  notion 
of  entropy  rate  of  a  stochastic  process  in  the  sense  of  Shannon 
(see  HAYKIN  [1979,  p.  80]),  and  this  gives  the  name  to  the  method. 

On  the  basis  of  the  above  it  has  been  argued  that  the  so-obtained 

pr- extension  of  C   is  maximally  noncommital  to  the  unavailable 

s 

data  (see  JAYNES  [1968]).   This  is  indeed  so,  as  far  as  the  prediction 
problem  is  concerned.  However,  the  prediction  should  be  more  of  an 
"excuse"  than  a  "reason"  (see  FURSTENBERG  [ i960,  p.  7]). 
In  point  of  fact,   KALMAN  [I98I]  argues  that  the 
partial  sequence  of  parameters  contains  certainly  more  information 
than  merely  the  fact  that  these  parameters  are  all  of  modulus  less 
than  1.   In  KALMAN  [I98I]  it  is  also  suggested  that  some  minimal 
dimension  pr-extension  is  perhaps  the  right  object  to  consider. 
Unfortunately,  the  description  of  the  minimal  dimension  pr-extensions 
seems  to  face  intractable  difficulties.  In  point  of  fact,  an  equi- 
valent question  was  considered  by  YOULA  and  SAITO  [I967]  in  a  circuit 
theoretic  context.   Currently,  this  problem  is  unsolved.  In  Appendix 
A  we  shall  indicate  some  computational  difficulties  that  arise  in 
the  simplest  nontrivial  case. 

12.  On  Pole- Zero  Modeling 

We  begin  by  assuming  knowledge  of  a  number  of  "influential 
zeros"  in  the  power  spectrum  of  a  stochastic  process.  This  rather 
loose  term  appears  to  have  a  rather  definite  meaning  in  the  more 
application-oriented  literature,   See  for  example  MAKHOUL  [1976, 
p.  115].  It  is  also  stated  that  pole-zero  modeling  is  not  simple 
and  not  well-understood.  We  shall  present  a  simple  recursive  way 
to  incorporate  the  "zero"  information  in  the  modeling  process. 

Let  C   be  a  partial  positive  sequence  and  d( z,  z"  )  be  a 

s 

given  dissipation  polynomial  of  degree  less  than  or  equal  to  s. 
From  the  results  of  Section  7  we  know  that  there  exists  an  associated 
pr-extension  of  C   of  degree  less  than  or  equal  to  s. 
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In  principal  this  pr-extension  can  be  found  as  a 
preimage  of  d(z,  z~  )  under  cp  .   Certain  techniques  have  been 
recently  developed  to  provide  constructive  algorithmic  procedures 
for  obtaining  a  solution  of  homotopy-based  existence  results  (see 
KELLOG,  II,  and  YORKE  [1976],  and  also  MEYER  [1968]).  However,  this 
is  very  cumbersome  and  objectionable  for  almost  all  practical 
purposes.  Thus,  we  shall  not  pursue  it  here  but  instead,  we  shall 
develop  an  approximate  but  efficient  solution. 

Our  first  tool  is  a  new  representation  for  partial  realizations 

of  C   of  dimension  less  than  or  equal  to  s.  Let  C   be  a  positive 
s  s 

sequence,  and  f  ( z) ,  <J>  ( z) ,  t  =  0,  1,  . . . ,  s  be  the  orthogonal 

polynomials  of  C  . 
s 

(12.1)   LEMMA.  Any  rational  function  c  tt(z)/x(z),  tt(z),  X(z)  G  C[z], 
with  tt(0)  =  X(0)  =1  and  power  series  expansion  that  begins  with 

s 


(12.2)   c  +  2c.  z  +  ...  +  2c  z  , 

v    '        o     1  s  ' 


is  of  the  form 


w(  z 
c 


'o  XI  z 


¥  (z)*  +  OLzf  .(z)*  +  ...  +  a  zs¥  (z)* 

sv  1  s-lv  s   ox  . 

$  (z)*  +  anz<J>  ,(z) *+...+  a  zS<d(z)* 
sv      1  s-lv  s   v 


This  result  was  independently  of  ours  obtained  by  KIMURA  [1983] 
who  also  argues  that  it  provides  a  canonical  form  for  partial  realization 
of  covariances.  In  our  work  a  precise  use  of  this  lemma  is  given  in 
Theorem  (12. k).     We  should  also  mention  that  this  lemma  is  really  a 
fact  about  partial  realizations  and  has  essentially  nothing  to  do  with 
positivity.  Positivity  is  assumed  for  the  sake  of  some  other  properties 
of  this  representation  that  we  shall  soon  discuss. 

PROOF  of  Lemma  (12.1).   The  polynomials  tt(  z)  and  X(z)   are 
related  through 
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S\  ns 


c  7r(z)  =  [X(z)(c  +  2c, z  +  ...  +  2c  z  )  ]  . 

o  v       v  ' K   o     1  s    o 


This  represents  a  nonsingular  transformation  between  polynomials  of  degree 

s-t 
less  than  or  equal  to  s.  The  two  sets  of  polynomials   {z   ¥.(z)*,  t  =  0, 

s-t 
1,  . ..,  s}  and  [z   0,(z)*,  t  =  0,  1,  ...,  s)  form  bases  for  this 

space  and  they  are  related  by 

c  zS"V(z)*  =  [zS"Y(z)*(c  +  2c  z  +  ...  +  2c  zS)]S, 

O       t  XT  v  O       1  SO' 

for  t  =  0,  1,  ...,  s,   as  it  follows  from  the  definition 

of  ¥,(z),  t  =  0,  1,  ....   The  proof  of  the  lemma  is  now  immediate.   □ 

This  lemma  places  a  system  of  coordinates,  in  the  linear  space  whose 
points  represent  partial  realizations  of  (12.2),  so  that  the  ME 
solution  lies  at  the  origin.  Another  aspect  of  this  representation 
is  shown  in  the  following: 

(12.3)   LEMMA.   Let 

7r(z)  »  l!  (z)*  +  a.z«  ,  (z)*  +  ...  +  a  zsf  (z)*, 

S  J-   S*"  J-  so 

and 

X(z)  =  $  (z)*  +  a  z$  _(z)*  +  ...  +  a  zsc>  (z)*. 

S  J-   S"*-L  3.    O 

The   polynomial  (in  z  and  z  ) 

d(z,  z"1)  =|{7r<z)5c(z"1)  +  x(z)£(z-1)} 

has  degree  t  <  s  if  and  only  if  a     =   . . .  =  cc    =  0. 

"         '     '  S  Xr  —  -L 

PROOF.   This  follows  from  the  fact  that  the  degree  of 
ys(z)5t(z_1)  +  d>s(z)$t(z_1) 
is  equal  to   |s  -  t|.   This  can  be  shown  using  Lemma  (2.6).   D 
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We  now  proceed  to  our  final 


(12. k)      THEOREM.   Let  C  =  [c   :  t  =  0,  1,  ...]  be  the  covariance 
sequence  of  a  nondeterministic  stochastic  process,  and  let 

T|(z)  =  1  +  a.  z  +  . . .  +  a  2 


u 
z 


be  any  polynomial  with  roots  in  ( |z |  >  1}.   Then, for  s  sufficiently 
large , 

f(s)  L)  y  (z)*  +  alZVl(z)*  +  ...  +auz\_u(z)* 

0  X(S)(Z)     °  0s(z)*  +  a^^z)*  +  ...  +  auzU$s_u(z)* 


(s) 

is  a  pr-extension  of  C  ,  and  if  jy    ' (z)  denotes  the  stable 

spectral  factor  of  the  associated  dissipation  polynomial,  then 

J^a,  n  (z)  =  ti(z)« 


s— >°° 


PROOF. 


Let  M  (z)  be  as  in  Theorem  (  3.1).  Then 


V  S)  ( z)  \  (?-\  z)  *  +  .  flj; J  *)*-...+  a/^  Z) 

)=  M   (z)*  I 

,x(  s)  ( z)  /  Vu"u( z)  * +  aizCi(  z)  * +  •  •  • +  vuC* z) 


where  f  "  (z),  $  "  (z)   are  the  orthogonal  polynomials  of  the 
parameter  sequence  R    =  {r     ,  ...,  r  }. 


Since  C  corresponds  to  a  deterministic  process,  it  follows 
from  the  result  of  GERONIMUS  [1961,  p.  159  ]  (see  (k.6))    that  the 
parameters  of  C  are  squarely  summable.  Hence,   as  s  -» »,  both 

^"U(z)^-,1 

and 


79 


<^"u(z)*  -+-i 


for  t  =  0,  1,  . . . ,  u.   Consequently,  as  s 


,s-u 


S-U/ 


¥to-u(z)*  +  a.zr_.u(z)*  + 
u  v      1  u-lv  ' 


+  a  zV'u(z)* 
u   o   v  ' 


S-U 


S-U/ 


u  v  '     1  u-lv 


U  S-U,  * 

+  a  z  $   (zl* 

u   o  v  ' 


tends  to  1  uniformly  on   |z|  <  1,   and  the  associated  dissipation 
polynomial  tends  to  ^(z)rj(z"  ).  Applying  now  Theorem  (5.1),    the 
proof  is  complete.   □ 


APPENDIX.   THE  MINIMAL  DIMENSION  PROBLEM 

Here  we  shall  consider  the  following  problem:   Given  a  partial 

covariance  sequence  C   find  (simple)  necessary  and  sufficient  con- 

s 

ditions  on  C   so  that  it  admits  a  pr-extension  of  dimension  strictly- 
less  than  s. 

This  question  is  certainly  the  first  one  in  attempting  to  obtain 
an  explicit  answer  to  the  minimal  dimension  problem  of  KALMAN  [I98I], 
and  YOULA  and  SAITO  [1967].  We  shall  discuss  the  first  two  simple 
cases:  s  =  2,    and  s  =  3«   The  case  s  =  2  is  trivial  as  it  requires 
conditions  for  the  positivity  of  a  degree  1  polynomial  in  z  and 
z~  .   The  case  s  =  3,   that  requires  conditions  for  the  positivity 
of  a  degree  2  polynomial  in  z  and  z  ,  presents  already 
difficulties  due  to  the  implicit  nature  of  the  conditions  that  seem 
to  be  possible  to  approach  only  with  the  techniques  of  decision 
methods  (see  JACOBSON  [1971*,  Ch.  Vj)  •   Although  this  appears  to  be 
quite  elementary,  it  should  be  noted  that  conditions  for  the 
first  case  only  exist  in  the  current  literature  (see 
KALMAN  [I98I],  and  also  KRISHNAPRASAD  [I98O]  in  an  equivalent  setting). 

We  begin  by  considering  the  case  s  =  2.  Unless  c,  =  0,  the 
minimal  dimension  partial  realization  of 

? 
1  +  2c  z  +  2c  z 

1     2 

is  of  dimension  1  and  given  by 


tt(z)    1  +  (a  +   c  )z 


X(z)  =   1  +  (a  -  c  ) 


z 


where  c  =  c  (c  -  a).  (Here  and  in  the  sequel  we  use  the  represen- 
tation introduced  in  Lemma  (12.1).)  Applying  Proposition  (5.2)  it  is 
straightforward  to  check  that  tt(z)/x(z)   is  in  C  if  and  only  if 

|c  I  <  1,  and 
(A.l)     X  " 

|a|  <  1  -  IcJ. 
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We  now  consider  the  case  s  =  5»  In  case  c. 


c  =  0  and  c  f  0, 


then  the  minimal  pr-extension  is  of  dimension  3-  In  case  c_  =  c,c  , 
then  the  minimal  pr-extension  is  either  of  dimension  1  or  3  depending 
on  whether  the  minimal  partial  realization  which  is  of  dimension 

1  is  in  C  or  not.   In  the  generic  case  we  consider  a  general 
rational  function  tt(  z)  /x(  z)  with  tt(  z) ,  X(  z)  polynomials  of  degree 

2  and   tt(0)  =  x(0)  =  1,  that  has  power  series  that  begins  with 


2       3 
1  +  2c  z  +  2c  z  +  2c,z-/. 


We  shall  restrict  our  attention  to  the  case  where  all  the  scalars 
take  real  values,  and  use  in  the  various  expressions  the  associated 
parameters  {r, ,  r  ,  r,}  instead  of  {c_,  c?,  c.,}.  The  function 
tt(z)/x(z)   is  of  the  form 


¥2(z)*  +  az?  (z)*  +  pz  T  (z)* 

p 

o  (z)*  +  azo  (z)*  +  pz  o  (z)* 


where  a    and  p  satisfy 


(A. 2)   (1  -  r^)(l  -  rg)r5  +  a(l  -  r^)r2  +  (3^  =  0. 


The  conditions 


7r(z)  +  X(z)  ^  0  for  all  z  in   |z|  <  1, 


tt(z)x(z"  )  +  tt(z"  )x(z)  >  0  for  all  z  on   |z|  =  1, 


give  rise  to  the  following: 


(A.3)   a(l  +  rx)  <  p  +  (1  +  rxXl-  r2) 
(A.k)       -  a(i  -  rj  <0  +  (1  -  rx)(l  -  rg) 
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(A. 5)   -  a(l  +  rx)  <  P  +  (1  +  r^fl  +  rg) 
(A.6)   a(l  -  rx)  <  p  +  (1  -  r^fl  +  r^ 

(A.7)   P  <  1 
and  either 

(A. 8)   Up  <  |a(l  -  r2)  +  ap  +  pr^  |  , 

or 


(A. 9)   a2(l  -  r2  -  p)2  +  p2r2r2  +  20^.^(1  -  r2  +  p)  - 

-  Up[p2  -  2p  +  (1  -  r2)(l  -  r2)]  <  0. 

In  general,  neither  of  the  above  conditions  is  redundant.   In  the 
(a,  p) -space,  these  conditions  cut  out  a  set  that  corresponds  to 
pr-extensions  of  C   of  dimension  2.   This  set  is  illustrated  below 
as  a  shaded  area  for  the  two  typical  cases. 
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Whether  C,  admits  a  pr-extension  of  dimension  2,  depends  on 
3 

whether  the  line  £     given  by  (A. 2)  intersects  the  shaded  region. 
Due  to  (A. 9)  which  is  implicit  in  a     and  p  and  is  of  degree  k, 
these  conditions  when  expressed  in  terms  of  the  original  parameters 
of  the  problem,  e.g.   r, ,  r  ,  and  r  ,   are  also  implicit  and 
extremely  involved. 
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